-- Logs begin at Wed 2022-05-11 16:02:36 UTC, end at Wed 2022-05-11 17:15:44 UTC. -- May 11 16:48:42.322377 dv-osbrick-836062-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 11 16:48:42.330679 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 16:48:42 2022] *** May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: nodename: dv-osbrick-836062-3-ceph May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: machine: x86_64 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: clock source: unix May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: pcre jit disabled May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: detected number of CPU cores: 4 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: current working directory: / May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: detected binary path: /usr/bin/uwsgi-core May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: your processes number limit is 47680 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: your memory page size is 4096 bytes May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: detected max file descriptor number: 2048 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: lock engine: pthread robust mutexes May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: thunder lock: enabled May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 16:48:42.335391 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 16:48:42.382849 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: Python main interpreter initialized at 0x55cd6922e9c0 May 11 16:48:42.382849 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: python threads support enabled May 11 16:48:42.382849 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: your server socket listen backlog is limited to 100 connections May 11 16:48:42.382849 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: your mercy for graceful operations on workers is 90 seconds May 11 16:48:42.383205 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: mapped 403077 bytes (393 KB) for 2 cores May 11 16:48:42.383269 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: *** Operational MODE: preforking *** May 11 16:48:42.383564 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: *** uWSGI is running in multiple interpreter mode *** May 11 16:48:42.383564 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: spawned uWSGI master process (pid: 86693) May 11 16:48:42.383771 dv-osbrick-836062-3-ceph systemd[1]: Started Devstack devstack@keystone.service. May 11 16:48:42.385003 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: spawned uWSGI worker 1 (pid: 86709, cores: 1) May 11 16:48:42.385334 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: spawned uWSGI worker 2 (pid: 86710, cores: 1) May 11 16:48:42.387299 dv-osbrick-836062-3-ceph devstack@keystone.service[86693]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 16:48:48.153803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 16:48:48.153803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: from cryptography.utils import int_from_bytes May 11 16:48:48.154594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 16:48:48.154594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: from cryptography.utils import int_from_bytes May 11 16:48:48.154703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 16:48:48.154703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: from cryptography.utils import int_from_bytes May 11 16:48:48.155096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 16:48:48.155096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: from cryptography.utils import int_from_bytes May 11 16:48:48.205298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 16:48:48.205469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 16:48:48.205692 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 16:48:48.205796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] command line args: [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 16:48:48.205866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 16:48:48.205937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 16:48:48.206106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] command line args: [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 16:48:48.206188 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ================================================================================ {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 16:48:48.206318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 16:48:48.206396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] admin_token = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.206454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ================================================================================ {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 16:48:48.206523 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] config_dir = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.206708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] admin_token = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.206793 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.206922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] config_source = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207007 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] config_dir = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] debug = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207283 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] config_source = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] debug = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.207751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.208853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.208853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.208853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.208853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.208853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_config_append = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209211 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_dir = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_file = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.209930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210719 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.210879 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_config_append = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_dir = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.211897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_file = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.212950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.213088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.213301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.213478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.213683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] publish_errors = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.213836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214166 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214351 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214540 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.214865 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215138 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] standard_threads = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215832 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.215966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.216095 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.216095 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.216354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.216483 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] use_journal = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.216619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.218689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] use_json = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.218689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] use_stderr = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.218983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219295 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] use_syslog = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219295 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.219994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] publish_errors = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.219994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.220495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.220632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.220779 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.220956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.220956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] standard_threads = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.221383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.221522 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.221691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.221877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.222011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.222141 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.222282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.222413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] use_journal = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.222540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.222668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] use_json = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.222668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] use_stderr = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.222971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.223196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] use_syslog = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.223496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.223649 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 16:48:48.223781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.223909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224046 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224389 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.224912 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225052 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225467 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225596 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.225996 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.226915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227044 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227173 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.227945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228858 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.228986 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229132 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229398 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229655 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229789 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.229925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230182 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.230868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231263 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231442 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.231914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232453 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232593 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.232984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233635 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233763 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.233897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234163 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234564 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234692 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.234957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235085 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235213 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235816 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.235943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236071 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.236912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237572 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.237957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.238897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239034 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239881 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.239881 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240376 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240643 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.240910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241585 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.241974 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242368 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242498 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242626 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242755 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.242884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243021 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243469 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243602 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243740 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.243949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244090 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244221 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244350 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.244745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.245372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.245509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.245638 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.245773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.245913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246052 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246183 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.246966 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.247947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248737 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248867 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.248996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249788 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.249917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250047 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.external = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250573 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250843 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.250980 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251110 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.password = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] auth.token = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.251960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252245 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252638 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.external = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252767 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.252906 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253182 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.password = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.253999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] auth.token = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254129 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.254926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255583 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.255923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256055 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256341 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256733 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.256864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257400 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.257931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258452 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.258873 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259263 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.259961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.260092 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.260221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.260427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261296 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.261973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262104 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262364 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.262905 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263175 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263686 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263816 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.263949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.264873 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265415 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265545 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.265946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.266800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267063 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267488 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267753 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.267883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268283 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268414 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.268684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269346 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.269875 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270403 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270538 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270679 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.270954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271641 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.271910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272040 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272527 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.272955 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.273881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274153 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.274956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275584 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.275863 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276158 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.276974 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277537 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.277940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278614 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278744 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.278885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279536 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279797 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.279927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280467 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.280867 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281007 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281576 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.281985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282114 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.282917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283046 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.283996 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284137 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284539 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284806 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.284938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285209 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285729 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.285868 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286292 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286428 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286564 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286709 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286848 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.286986 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287438 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.287941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288363 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.288933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289206 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289351 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] role.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.289909 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] role.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290056 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290341 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290614 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.290888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.291782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] role.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292220 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] role.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.292913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293188 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.293893 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294032 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294597 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.294989 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295136 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295433 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.295859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296006 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296405 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296542 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296678 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296822 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.296961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297273 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297564 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.297985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.298965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299754 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.299890 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300171 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.300866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301011 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301287 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301579 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301717 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301717 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.301985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302394 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302676 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302815 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.302951 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.303961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304518 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.connection = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.304947 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305727 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.305865 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306418 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.306969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.307145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.connection = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.307312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.308952 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309539 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309822 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.309960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.310110 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.310331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.310522 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.310712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.310901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 16:48:48.311845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 16:48:48.322696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.322975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.323765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.324147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.324378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.324599 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.332746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.333382 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.361051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.361335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.361710 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.361941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.414170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.414641 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.466151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.466454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.467078 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.467312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.532724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533015 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533163 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533747 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.533884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.534030 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.534167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.534317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.534317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.557420 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.558942 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559231 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.559866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.560007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.570745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.576107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.585842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.586080 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.586290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.586510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.586750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.587032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.587467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86709) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.587686 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.587921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.588147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.588371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.588606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.588810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.589027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86710) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 16:48:48.606479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.606694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 16:48:48.607037 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.607148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.607231 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 16:48:48.607522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.607610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 16:48:48.607783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.608043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.608226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.608469 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.608596 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 16:48:48.608986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.609350 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.609710 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.610073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.619602 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.619875 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.620772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.621055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.622268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.622656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.623034 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.623462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.629485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.632116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.632902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.633182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.633465 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.633753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.634038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.634298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.634566 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.634839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.635112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.635408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.635708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.636735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.637122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.637509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.637895 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.638293 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.638658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.639033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.639454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.639834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.640215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.640592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.662664 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.664368 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.664603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.668319 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.670100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.670504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.670584 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.670870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.671153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.676408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.676855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.677250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.678888 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.679190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.684436 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.684724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.685009 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.685293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.685570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.685847 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.686390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.686390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.686659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.687051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.691722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.692126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.692517 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.692909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.693310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.693695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.694074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.694448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.705429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.705711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.710289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.714001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.714298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.714379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.714721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.719445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.719535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.723075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.723437 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.723836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.726782 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.727081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.727382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.727672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.727953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.728234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.730288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.734076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.737891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.738299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.738700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.739091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.739511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.739910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.748479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.748766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.749036 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.749297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.757289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.759014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.759301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.760636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.761028 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.761402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.761772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.762540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.762834 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.763117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.763428 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.763707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.770367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.772237 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.772627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.775986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.779387 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779387 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779387 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.779723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.779818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.792582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.792999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.793388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.793775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.794159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.794603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.794989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.797901 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.801236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.804633 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.806239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.808075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.808345 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.808637 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.814135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.816736 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.821952 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.822043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.822128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.822223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.822223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.822459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.822632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.823244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.825212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.825527 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.825908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.833672 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.834042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.834336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.834620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.835609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.839484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.839851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.840222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.840574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.843072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86710) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.843386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.843647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.843932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.844205 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.844488 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.844761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.845127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.845404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.845695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.845965 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.846227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.846492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.846772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86710) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.851202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.851614 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.851981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.860524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86709) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 16:48:48.860882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.861236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.861661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.861953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.862306 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.862661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.864179 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.864558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.864940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.865310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.865659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.866008 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.866360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86709) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 16:48:48.885119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd6922e9c0 pid: 86710 (default app) May 11 16:48:48.888762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e31b-98d0-4fb1-a911-431b02fecf76 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:48:48.889068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e31b-98d0-4fb1-a911-431b02fecf76 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:48:48.889350 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e31b-98d0-4fb1-a911-431b02fecf76 None None] PATH_INFO: `/v3` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:48:48.893560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Wed May 11 16:48:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:48:48.905448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd6922e9c0 pid: 86709 (default app) May 11 16:48:57.013509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:48:57.014062 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:48:57.014062 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:48:57.015441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:48:57.023010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:48:57.023430 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:48:57.023617 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:48:57.054378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG oslo_db.sqlalchemy.engines [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 16:48:57.240566 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG passlib.handlers.bcrypt [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86709) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 16:48:57.240984 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG passlib.handlers.bcrypt [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86709) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 16:48:57.296711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:48:57.298234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:48:57.418427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 1/3] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:48:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 16:48:57.558601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:48:57.593043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 16:48:57.723547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fe44-5635-4f1f-99f9-0c808936b394 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:48:57.727737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:48:57.728404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:48:57.728692 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:48:57.729010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:48:57.737187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:48:57.788479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 16:48:57.788821 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95dd2-777b-41f3-aee7-7aa8c6a8fb7c admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:48:57.798072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1324 bytes} [Wed May 11 16:48:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 16:48:57.804080 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:48:57.819849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f90993-75cf-46a3-acef-3c0e3cd6fbe2 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:48:57.824885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:48:57.826005 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:48:57.826293 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:48:57.826574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] PATH_INFO: `/v3/projects/f17a7c59ed4e463892351b1b51c21b1b` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:48:57.828080 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] RBAC: Authorizing `identity:get_project(project_id=f17a7c59ed4e463892351b1b51c21b1b)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:48:57.877541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 16:48:57.877882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb98ee-2a55-4a35-8892-fed90d8e31ae admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:48:57.882409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 2/5] 10.222.0.58 () {56 vars in 1207 bytes} [Wed May 11 16:48:57 2022] GET /identity/v3/projects/f17a7c59ed4e463892351b1b51c21b1b => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:00.107870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9803-f9be-40a0-bfba-7ff4f150fb7a None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:00.108421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9803-f9be-40a0-bfba-7ff4f150fb7a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:00.108421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9803-f9be-40a0-bfba-7ff4f150fb7a None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:00.112533 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 4/6] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:00.118150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:00.118551 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:00.118700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:00.138073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:00.139605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:00.147249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 16:49:00.171027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9803-f9be-40a0-bfba-7ff4f150fb7a None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:00.182894 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9803-f9be-40a0-bfba-7ff4f150fb7a None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:00.187050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:00.187708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:00.187996 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:00.188277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:00.195768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:00.197526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eec25-790e-4a3b-951c-df0e5706dde1 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:00.206272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1324 bytes} [Wed May 11 16:49:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 16:49:00.211461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:00.220753 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe977-dcd7-414e-b6d6-045ee7afafba None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:00.225701 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:00.226571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:00.226858 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:00.227137 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:00.228594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:00.231066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa1b3-a3df-4ab5-963f-456f53b4cf41 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:00.232689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 4/9] 10.222.0.58 () {56 vars in 1198 bytes} [Wed May 11 16:49:00 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:02.535519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7973d-b8de-4f84-aed4-2ae81eeca1dd None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.536025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7973d-b8de-4f84-aed4-2ae81eeca1dd None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.536117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7973d-b8de-4f84-aed4-2ae81eeca1dd None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.537392 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:02.543059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.543528 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.543627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.559645 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:02.560807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:02.585600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c3be-c456-4aa7-a071-75eb4cbf46ac None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.585870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c3be-c456-4aa7-a071-75eb4cbf46ac None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.586147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c3be-c456-4aa7-a071-75eb4cbf46ac None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.587501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 7/11] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:02.592821 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.593111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.593387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.631438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG passlib.handlers.bcrypt [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86710) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 16:49:02.631863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG passlib.handlers.bcrypt [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86710) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 16:49:02.637599 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:02.662019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:02.678647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:02.680248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:02.754783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6790f-0ec5-4b8d-b39b-e72abf8bb32b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:02.775236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:02.786658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:02.787477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.787766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.788043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.798297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:02.799224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:02.810758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:02.812001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:02.812803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 6/14] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:02.817917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:02.899522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c577a9-55af-47d2-aa95-992c5e2fe711 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:02.910969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11b14-c79f-41e0-9bbb-9cc34f798f8d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:02.931085 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:02.932033 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.932321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.932597 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.941795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:02.942451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:02.942731 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:02.943003 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:02.943774 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:02.944079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:02.945464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:02.957374 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 7/15] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:02.962772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:02.997437 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:02.998933 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.054155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a164-aebd-4220-b37b-5b09c5593ae5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:03.206004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 9/16] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 16:49:03.206225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:03.207005 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:03.207285 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:03.207600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:03.208796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:03.210246 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.211629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:03.211864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 8/17] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:02 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:03.216892 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:03.304591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c35e15-b580-48e2-a9a8-160df154e787 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:03.309752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cc59-3d0a-44b8-85d5-a5c9b2951d02 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:03.336803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:03.337584 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:03.337867 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:03.338156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:03.341116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:03.341894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:03.342181 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:03.342456 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:03.343645 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:03.345076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.346651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:03.352222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:03.356422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:03.357882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:49:03.378066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:03.379043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:03.380244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:49:03.380244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:49:03.380244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:49:03.380244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:03.380244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:03.385665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:03.450539 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a05d-05ff-459f-892e-042bea0c5ec4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:03.483649 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:03.484305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:03.484588 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:03.484866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:03.485688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.domain.id=default, user.id=20792e246db94bf6a86a88130fe78b74) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:03.485993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:03.487252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61b18-5dbf-4ee7-882b-797e4a8c2fe3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:03.487460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80a3c2-dd2e-4093-ba11-432168451cf2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.493857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1322 bytes} [Wed May 11 16:49:03 2022] GET /identity/v3/role_assignments?user.id=20792e246db94bf6a86a88130fe78b74&scope.domain.id=default&role.id=df86ea59d76740488f867f6211ccfa28 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:03.521643 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:03.522329 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:03.522609 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:03.522886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:03.523659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:03.523966 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:03.525420 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308107c5-df8b-4e54-851d-2a589cbf9c4d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:03.544520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 11/21] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:06.418409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f7db-4432-49ab-a946-ec184dd9b8a3 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.419503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f7db-4432-49ab-a946-ec184dd9b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.420040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f7db-4432-49ab-a946-ec184dd9b8a3 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.421857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 11/22] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:06.430469 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.431283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.431791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.453535 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:06.455227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:06.546318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:06.579961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f7db-4432-49ab-a946-ec184dd9b8a3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:06.712048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f7db-4432-49ab-a946-ec184dd9b8a3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:06.750373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:06.751174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.751487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.751761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.762233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:06.763738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-cc9737eb-12b4-48de-b2c9-e87e06da5fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:49:06.790682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:06.792147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:06.792935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:49:06.792935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:49:06.792935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:49:06.792935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:06.792935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 12/24] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:06.798343 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:06.908850 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b700e5-1177-4818-9d0d-b1598dd412e7 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:06.946811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:06.947560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.947844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.948117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.948849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:06.949161 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:06.950568 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:06.955248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196cbb-09c8-4c1a-a875-1c0d15bfc3a9 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.955569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196cbb-09c8-4c1a-a875-1c0d15bfc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.955843 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196cbb-09c8-4c1a-a875-1c0d15bfc3a9 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.957400 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 13/25] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:06.967455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 13/26] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:06.973235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00391a9-61d8-4bd0-9712-d240e47bac08 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:06.973525 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00391a9-61d8-4bd0-9712-d240e47bac08 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:06.973805 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00391a9-61d8-4bd0-9712-d240e47bac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:06.987261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.007587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f00391a9-61d8-4bd0-9712-d240e47bac08 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:07.008783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f00391a9-61d8-4bd0-9712-d240e47bac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:07.110735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf7aed-842f-4512-9bf0-0269340dec30 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.138212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 14/27] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:07.139316 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed9441-0fb1-4850-930e-bf63dc1c35da None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.139633 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed9441-0fb1-4850-930e-bf63dc1c35da None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.139897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed9441-0fb1-4850-930e-bf63dc1c35da None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.141479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 15/28] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:07.148572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.148862 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.149149 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.152646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.153619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.154203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.154720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.155954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:07.157647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9095-ad69-4fd9-914a-2bda06d8a1fe None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:07.188418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:07.189711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:07.297857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 16/29] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:07.298408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.332084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 14/30] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:49:06 2022] POST /identity/v3/projects => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:49:07.335698 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db20e-54a6-4963-be93-3bd173680745 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.336301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db20e-54a6-4963-be93-3bd173680745 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.336836 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db20e-54a6-4963-be93-3bd173680745 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.338968 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 15/31] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:07.340056 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5db20e-54a6-4963-be93-3bd173680745 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.430363 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de9c6-012d-4764-bfc6-9cd95b5d6d82 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.467142 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5db20e-54a6-4963-be93-3bd173680745 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.468119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.468925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.469215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.469489 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.481220 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-636501b2-5ae3-4396-943b-a16e0192f714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:07.489335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:07.490243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:07.491493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 17/32] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:07.496851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd65a-1c6a-4b5d-8a68-39b335368863 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.496851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd65a-1c6a-4b5d-8a68-39b335368863 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.497092 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd65a-1c6a-4b5d-8a68-39b335368863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.512499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.513624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.514107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.514630 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.515646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:07.515861 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ad3cd65a-1c6a-4b5d-8a68-39b335368863 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:07.517035 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ad3cd65a-1c6a-4b5d-8a68-39b335368863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:07.518212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabd23e-f206-4def-b744-08415bc75ffd None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:07.538265 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 16/33] 10.222.0.58 () {60 vars in 1131 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/roles => generated 225 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:07.540170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680ba2-fd07-488a-8e84-376f5ce1654d None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.540663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680ba2-fd07-488a-8e84-376f5ce1654d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.541234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680ba2-fd07-488a-8e84-376f5ce1654d None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.544076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 17/34] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:07.545301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60680ba2-fd07-488a-8e84-376f5ce1654d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.622650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 18/35] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:07.623926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7101-e06b-462e-9ce9-be48ae6da529 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.624218 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7101-e06b-462e-9ce9-be48ae6da529 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.624496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7101-e06b-462e-9ce9-be48ae6da529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.641935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-dc2a7101-e06b-462e-9ce9-be48ae6da529 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:07.643261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-dc2a7101-e06b-462e-9ce9-be48ae6da529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:07.672591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60680ba2-fd07-488a-8e84-376f5ce1654d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.714405 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.715097 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.715391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.715677 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.716445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:07.716754 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:07.718187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9e26-12f5-4d6a-ac40-da5eb8704c16 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:07.728714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 19/36] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:07.730933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f75145-2e68-4cea-aa80-e69877a66081 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.731341 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f75145-2e68-4cea-aa80-e69877a66081 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.731764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f75145-2e68-4cea-aa80-e69877a66081 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.737189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 20/37] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:07.737189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f75145-2e68-4cea-aa80-e69877a66081 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.739828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 18/38] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:07.741451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.741957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.742451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.762614 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:07.764144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:07.840652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:07.850717 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:07.852531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f75145-2e68-4cea-aa80-e69877a66081 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.884681 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.885788 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.886066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.886336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.887064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:07.888467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:07.934943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1aa68-70c9-467c-857b-719a6e873515 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:07.967165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:07.968060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:07.968345 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:07.968626 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:07.970031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:07.971498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:07.973093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 20/40] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:07 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:07.973822 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:08.008966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1131 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/roles => generated 219 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:08.009787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:08.078320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68495b46-1d56-446e-9372-f98488e694ba None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:08.116930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:08.117589 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee332-44c7-4177-b3d0-d4c8e7f49c2c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:08.117697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:08.117884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:08.118160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:08.118918 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:08.120430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:08.135804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1131 bytes} [Wed May 11 16:49:07 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:08.136576 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:08.179686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:08.181179 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:08.182176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:08.183072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:08.185872 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:08.188069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:08.191666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:08.197047 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:08.278956 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15635-4998-4310-ba5b-9ac523b86afa None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:08.318093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:08.319177 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:08.319499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:08.319782 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:08.321010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:08.323032 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:08.325032 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 22/44] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:08.330535 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:08.332390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa2d8-878a-4417-b6e1-2ec71454f0c9 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:08.365338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:08.366003 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:08.366289 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:08.366578 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:08.367292 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:08.368794 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06910-aaa4-46ea-9c8f-e4f8cce67f4e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:08.399468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:49:08 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:08.435014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f64dc-bdf0-4071-b05a-31e592c2f492 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:08.470433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:08.471332 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:08.471651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:08.471937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] PATH_INFO: `/v3/domains/default/users/20792e246db94bf6a86a88130fe78b74/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:08.474118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=20792e246db94bf6a86a88130fe78b74, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:08.475628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211193ab-4962-426f-8e7b-88ac23302cfc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:08.493427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 23/46] 10.222.0.58 () {58 vars in 1361 bytes} [Wed May 11 16:49:08 2022] PUT /identity/v3/domains/default/users/20792e246db94bf6a86a88130fe78b74/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 16:49:10.680459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe41f-46d9-4b0a-a371-76be192aa6f5 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.681064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe41f-46d9-4b0a-a371-76be192aa6f5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.681064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe41f-46d9-4b0a-a371-76be192aa6f5 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:10.682483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 24/47] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:10.687873 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.688284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.688560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:10.707876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:10.709187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:10.751971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed813c-c062-476f-9f27-bec5ff84fea9 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.752178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed813c-c062-476f-9f27-bec5ff84fea9 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.752460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed813c-c062-476f-9f27-bec5ff84fea9 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:10.753814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 25/48] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:10.758712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.758999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.759275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:10.776471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:10.778000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:10.779078 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 24/49] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:10.803489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:10.842383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 26/50] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:10.866515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:10.904087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9e2fa-477f-4a68-8fca-7b9781e778ad None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:10.938737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:10.939558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.939848 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.940136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:10.941318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:10.943914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:10.946366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 25/51] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:10.952484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:10.959248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b6226-2b07-4abe-b433-693761a9690c None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:10.991748 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:10.992538 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:10.992829 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:10.993111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.002939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:11.011103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:11.011996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:11.012739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 27/52] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:11.019177 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:11.049624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da4ec-14f5-4f39-a9cc-0be74e8ee56c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:11.081756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:11.082417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:11.082699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:11.082973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.083712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:11.085149 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:11.111379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 26/53] 10.222.0.58 () {60 vars in 1140 bytes} [Wed May 11 16:49:10 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:49:11.119856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04cff-7bdb-46ac-9b63-0d5afd301a08 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:11.157996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:11.158682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:11.158969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:11.159251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.160051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:11.160365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:11.161781 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:11.170984 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 28/54] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:11.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:11.282766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414ca28-78bb-4f98-9dac-99ec1bf323c0 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:11.316775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:11.317655 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:11.317937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:11.318210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.319561 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:11.321008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:11.323178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:11 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:11.328735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:11.424694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e18b5-1bb9-4f35-a5c2-a536e14b4b1c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:11.457720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:11.458513 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:11.458799 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:11.459078 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.460300 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:11.461769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c93db-85b5-4dae-94c4-46feb32410a9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:11.463483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 29/56] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:11.468949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:11.562537 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0124d74-65d8-476e-bb4e-65a743bc532b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:11.594147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:11.594799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:11.595085 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:11.595381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:11.596219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.domain.id=default, user.id=20792e246db94bf6a86a88130fe78b74) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:11.596535 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:11.597969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f841da0-dd09-40e6-920c-bd8175b4d9b3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:11.605744 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1322 bytes} [Wed May 11 16:49:11 2022] GET /identity/v3/role_assignments?user.id=20792e246db94bf6a86a88130fe78b74&scope.domain.id=default&role.id=df86ea59d76740488f867f6211ccfa28 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:13.409622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859730-20f0-4c77-a6bb-4717f805304a None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:13.410168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859730-20f0-4c77-a6bb-4717f805304a None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:13.410168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859730-20f0-4c77-a6bb-4717f805304a None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:13.411593 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 30/58] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:13.417278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:13.417712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:13.417842 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:13.434649 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:13.435924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:13.498855 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:13.523927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859730-20f0-4c77-a6bb-4717f805304a None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:13.618933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859730-20f0-4c77-a6bb-4717f805304a None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:13.649566 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:13.650830 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:13.651130 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:13.651441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:13.652668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:13.654127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a193f-5898-430a-b70a-99e0a56a5e26 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:13.655739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 31/60] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:13.661053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:13.752558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6692a8c-a0ae-48ed-af46-d3f237e5c1f7 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:13.783748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:13.784404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:13.784689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:13.784967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:13.785709 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:13.787150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd102c5-cc87-4aa6-90bc-42da533f106a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:13.812415 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 30/61] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:13 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:17.299733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc16-eebd-462c-9bab-aace5ea14c54 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.300745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc16-eebd-462c-9bab-aace5ea14c54 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.301254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc16-eebd-462c-9bab-aace5ea14c54 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.302829 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 32/62] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:17.309144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6135e5-82a1-4f3c-8103-5035493fb9ee None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.309987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6135e5-82a1-4f3c-8103-5035493fb9ee None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.310456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6135e5-82a1-4f3c-8103-5035493fb9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.334022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2d6135e5-82a1-4f3c-8103-5035493fb9ee None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:17.335539 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2d6135e5-82a1-4f3c-8103-5035493fb9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:17.429002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 31/63] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:17.455270 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcc16-eebd-462c-9bab-aace5ea14c54 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:17.518389 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f50a-8527-44f9-915e-24e5d1434751 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.518721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f50a-8527-44f9-915e-24e5d1434751 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.518955 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f50a-8527-44f9-915e-24e5d1434751 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.520357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 32/64] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:17.528322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a468-fb1d-4ac8-8971-2111422acc92 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.528610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a468-fb1d-4ac8-8971-2111422acc92 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.528888 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a468-fb1d-4ac8-8971-2111422acc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.580744 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-53e9a468-fb1d-4ac8-8971-2111422acc92 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:17.581860 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-53e9a468-fb1d-4ac8-8971-2111422acc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:17.589040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcc16-eebd-462c-9bab-aace5ea14c54 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:17.636807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:17.637634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.637924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.638207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.655623 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-84e71899-6adb-45d0-ad1c-86ab67e56e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:17.663917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:17.664818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:17.665654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:17.668755 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 33/65] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:17.670348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbff7-ebc2-4ad5-ae1e-739a9204f70b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.670846 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbff7-ebc2-4ad5-ae1e-739a9204f70b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.671333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbff7-ebc2-4ad5-ae1e-739a9204f70b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.673205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 34/66] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:17.678437 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbff7-ebc2-4ad5-ae1e-739a9204f70b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:17.684086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 33/67] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 16:49:17.685775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.686270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.686746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.706080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:17.707569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:17.777289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 34/68] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:17.780236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:17.789758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbff7-ebc2-4ad5-ae1e-739a9204f70b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:17.824238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:17.824900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.825946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.825946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.826184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:17.826514 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:17.830266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316d5c-c6a0-4762-8458-5a738feb4198 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:17.836686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:17.838038 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85f10-30e4-462a-afa2-c74001710695 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.838330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85f10-30e4-462a-afa2-c74001710695 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.838613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85f10-30e4-462a-afa2-c74001710695 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.840238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 36/70] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:17.841124 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85f10-30e4-462a-afa2-c74001710695 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:17.891514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9dea-0078-4c0e-b888-3e4b19a55aa4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:17.922893 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:17.923700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.924056 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.924336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.935377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:17.935593 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85f10-30e4-462a-afa2-c74001710695 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-32b83ec1-9336-49de-a21e-f0dacde3b0c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:17.944075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:17.944915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:17.945823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:17.946880 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b17cf-eb97-4acc-906d-b13776be946e None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.946880 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b17cf-eb97-4acc-906d-b13776be946e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.946994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b17cf-eb97-4acc-906d-b13776be946e None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.948391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 36/72] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:17.950219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b17cf-eb97-4acc-906d-b13776be946e None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:17.968638 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:17.969424 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.969718 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.969994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:17.980116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-8244ea56-2491-4d3a-af9b-691280cfa6ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:17.987832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:17.988688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:17.989422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:17.990311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:17.990620 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:17.990868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.007058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:18.008312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:18.049470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b17cf-eb97-4acc-906d-b13776be946e None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.069876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:18.070690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.080950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.081818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.082106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.082385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.097304 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.098712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5c6f-d27b-46fc-b28b-0720b4632375 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.100426 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:17 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.101632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.101881 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.102159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.118086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:18.119253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:18.176274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96da395-b98f-43e0-9ec3-2b1c6dcfbcb1 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.180777 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 38/76] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:18.181720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.210024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.210689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.210972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.211250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.212019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:18.212330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.214205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.226248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 39/77] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.226248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.279920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d343d31-2fbe-4f81-a8e4-78cdd9b1b879 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.311446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.312070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.312297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.312568 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.313308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:18.313610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.314007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f4e-a597-45fc-a406-9d107fe348e7 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.314980 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.322650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 39/78] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.324233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.346205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.347004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.347293 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.347683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.357768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:18.365776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:18.366601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 40/79] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:18.372235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.418624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7646-dfbe-4264-ac82-31f59db70d77 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.449619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.450255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.450536 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.450809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.464841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e270-c6e3-40e4-85f6-bc795a27d7f3 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.498157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.498937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.499222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.499530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.500694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.502133 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.503806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 41/80] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.508458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.515744 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.517211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.596229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16d50-dfa2-4d4e-81a0-a170f7fff52f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.607920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 40/81] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:18.608731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.629346 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.630218 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.630510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.630795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.632013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.633464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.635072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 42/82] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.635972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.703039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09bd4-b3c0-42c7-a856-4611b3a6081f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.727656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d0da-1f31-4e26-8771-fbe74acdc343 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.734590 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.735468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.735751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.736026 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.737197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.738619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.740258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 41/83] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.740988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.759992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.760661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.760947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.761227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.761970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:18.762282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.763694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.771127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.771998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.835133 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba8efe-0e9e-43fb-9c25-91d8d1fc24b0 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.868275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.868862 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.869169 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.869444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.870144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.870568 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b4aaf-f35c-4074-b09b-bd362e3da9a8 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:18.871620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.889818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 42/85] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:18 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:18.890651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:18.913959 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:18.914845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:18.915132 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:18.915448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:18.917327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:18.918909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:18.920795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 44/86] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:18.921618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.004606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe19fd-e86d-4613-b509-5c823ccee441 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.024959 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0374-39fc-453c-ba79-03a528f13d15 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.039792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.040469 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.040755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.041654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.059425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.060093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.060379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.060658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.116000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.117496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.130262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.131704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.236010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:19.236861 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.254026 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:19.254992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.336168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318151-1959-4468-8b44-b39185f5da7f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.355324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbfb83-b545-4549-a3d0-517b7acd0c1a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.372149 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.373028 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.373313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.373591 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.374796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.376276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.377898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 46/89] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:19.378662 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.390138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.390730 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.391014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.391294 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.392181 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:19.392500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.393960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.399553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 44/90] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:19.401001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.484200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c09b9b-b2ea-47c4-94dc-e8d808352911 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.505048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f388cc-28cf-48ed-9049-6c729f7e0540 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.520728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.521968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.522450 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.522948 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] PATH_INFO: `/v3/projects/242d31866225418caf5193a9fdbfaa2e` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.524611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] RBAC: Authorizing `identity:get_project(project_id=242d31866225418caf5193a9fdbfaa2e)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.526361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.528349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 47/91] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/projects/242d31866225418caf5193a9fdbfaa2e => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:19.529309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.546779 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.547971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.548260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.548539 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.549961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.551828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.553609 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 45/92] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:19.555104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.688530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1c2b-1896-493f-8056-1ecdcff51f36 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.706943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726f6c-2d86-4faf-b6dd-bbd87d00e0de None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.727867 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.728894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.729427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.729915 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.751404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.751404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.751404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.751404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.751791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=242d31866225418caf5193a9fdbfaa2e, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:19.751791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.751791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.761689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 46/93] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=242d31866225418caf5193a9fdbfaa2e&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:19.762593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:19.905404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e6e73-f25b-4677-b644-6f915603be31 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:19.937957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.944029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.956355 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:19.957065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:19.957356 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:19.957639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:19.958522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=20792e246db94bf6a86a88130fe78b74) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:19.958840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:19.960390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:19.979161 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 47/94] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/role_assignments?user.id=20792e246db94bf6a86a88130fe78b74&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=df86ea59d76740488f867f6211ccfa28 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:20.091733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 48/95] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:20.100712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:20.239148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579796c-c7a4-46dd-b773-d0673b364d23 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:20.296084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:20.297418 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:20.297845 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:20.298270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:20.304421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:20.306799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1a83b-60dd-4e9a-bcfa-8adc4491f723 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:20.310247 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 48/96] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:20 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:20.316720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:20.423993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d4c7-03b9-45a4-a00e-5c4515ccdea2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:20.463449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:20.464494 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:20.464981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:20.465473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:20.466510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] RBAC: Adding query filter params (role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:20.467025 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:20.468743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e419-d062-44f1-bead-e5d61f9b3e0f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:20.479425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 49/97] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:20 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:22.227163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d771df-57d9-4d9c-b543-c84ed0876d26 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.230236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d771df-57d9-4d9c-b543-c84ed0876d26 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.230744 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d771df-57d9-4d9c-b543-c84ed0876d26 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.232396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 49/98] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:22.238096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.238583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.238770 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.260938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:22.262150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:22.294687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aec3-b283-404c-bb1a-042af6f28354 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.295417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aec3-b283-404c-bb1a-042af6f28354 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.295912 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aec3-b283-404c-bb1a-042af6f28354 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.297473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 50/99] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:22.307474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.308279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.308766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.335550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:22.337096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:22.357982 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:22.389847 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:22.441642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 51/101] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:22.486965 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:22.526506 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3bbc5-881f-4fe8-8c4c-918843d85c48 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:22.578886 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:22.579973 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.580257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.580528 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.596472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:22.604342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:22.605231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:22.606421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 51/102] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:22.612356 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:22.713531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714963b4-4a83-49e0-b89c-ddc207f75314 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:22.787516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:22.788241 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.788526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.788802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.789971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:22.791497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:22.793111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 52/103] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:22.794975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cab9c-fd56-4404-9035-bd743f0ccdaf None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:22.807547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:22.888599 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:22.889285 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.889574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.889855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.890609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:22.890917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:22.892346 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a086-9e84-458d-9a4d-ddc926e573d0 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:22.909431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 52/104] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:22.910778 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb5ef-c18a-468d-b648-644b165a4c3f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.911072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb5ef-c18a-468d-b648-644b165a4c3f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.911373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb5ef-c18a-468d-b648-644b165a4c3f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.912618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 53/105] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:22.920283 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb5ef-c18a-468d-b648-644b165a4c3f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:22.932563 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f321e-6789-49b3-8253-87c66fbc3588 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:22.967239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:22.968314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:22.968818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:22.969299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:22.970214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:22.971899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987e0c6-1932-4a2d-896a-5f6c32deeab3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.000570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 53/106] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:49:22 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:49:23.002829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f465-795c-443d-8708-69a535d176cf None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.003381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f465-795c-443d-8708-69a535d176cf None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.003985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f465-795c-443d-8708-69a535d176cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.024847 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-e544f465-795c-443d-8708-69a535d176cf None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:23.026687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-e544f465-795c-443d-8708-69a535d176cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:23.169490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 54/107] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:23.173943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb5ef-c18a-468d-b648-644b165a4c3f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.211971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f465-795c-443d-8708-69a535d176cf None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.214953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.216159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.216682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.217229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] PATH_INFO: `/v3/users/ca013c31af4847a29ccf8f0c88da71c2` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.233534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] RBAC: Authorizing `identity:get_user(user_id=ca013c31af4847a29ccf8f0c88da71c2)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:23.235386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.237846 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 54/108] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:22 2022] GET /identity/v3/users/ca013c31af4847a29ccf8f0c88da71c2 => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:23.245145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.359838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f465-795c-443d-8708-69a535d176cf None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.396939 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.398112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.398607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.399103 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.425116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-b735c583-caa5-4a33-bfd1-c34c7c3637f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:23.439325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:23.440684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:23.441878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:23.445484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 55/109] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:23.448021 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501cbca-9ea4-476d-8025-24abbbc72c77 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.448511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06dc2f-0425-4d12-a8d8-e07135033ac3 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.449286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06dc2f-0425-4d12-a8d8-e07135033ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.450055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06dc2f-0425-4d12-a8d8-e07135033ac3 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.452801 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 56/110] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:23.454034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06dc2f-0425-4d12-a8d8-e07135033ac3 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.505502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.506616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.507585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.508219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.591414 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06dc2f-0425-4d12-a8d8-e07135033ac3 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.591604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:23.593116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.637433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.638115 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.638399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.638674 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.639453 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:23.639764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:23.641173 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74edf4-3978-4c03-94e1-1ac1afe3e702 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.658544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 57/111] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:23.660001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de75-97eb-4171-a43c-eb10f930d0d9 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.660302 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de75-97eb-4171-a43c-eb10f930d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.660581 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337de75-97eb-4171-a43c-eb10f930d0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.684882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4337de75-97eb-4171-a43c-eb10f930d0d9 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:23.686077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4337de75-97eb-4171-a43c-eb10f930d0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:23.720856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 55/112] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:23.722066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.761710 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 58/113] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:23.767492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89175-4935-492e-a070-50f5e53fe757 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.767492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89175-4935-492e-a070-50f5e53fe757 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.767492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89175-4935-492e-a070-50f5e53fe757 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.767492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 59/114] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:23.767492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b89175-4935-492e-a070-50f5e53fe757 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.848733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278252d-3385-4927-b00c-2392addf5704 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.882408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.883278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.883594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.883880 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.885576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:23.887011 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29b4c-20a8-4ac6-995f-a083910aacb5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.888470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b89175-4935-492e-a070-50f5e53fe757 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:23.888655 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 56/115] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:23.894131 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea3da-b6c2-4cc3-8c85-0823956a7cce None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.894421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea3da-b6c2-4cc3-8c85-0823956a7cce None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.894702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea3da-b6c2-4cc3-8c85-0823956a7cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.910741 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-b62ea3da-b6c2-4cc3-8c85-0823956a7cce None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:23.911930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-b62ea3da-b6c2-4cc3-8c85-0823956a7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:23.924072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:23.924927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.925209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.925485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.926650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:23.928116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:23.929783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 60/116] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:23.930534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:23.983037 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 57/117] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:23.984369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f13c-bc1e-43d4-ab73-a80aa74efdd3 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:23.984662 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f13c-bc1e-43d4-ab73-a80aa74efdd3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:23.984939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f13c-bc1e-43d4-ab73-a80aa74efdd3 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:23.986191 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 58/118] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:23.986878 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f13c-bc1e-43d4-ab73-a80aa74efdd3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.036668 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fea9a-7551-4d86-b16f-6b339b305771 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.069839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.070636 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.070917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.071189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.081201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:24.089399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:24.090217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:24.090977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 61/119] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:24.092227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.093162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f13c-bc1e-43d4-ab73-a80aa74efdd3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.127809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.128665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.129016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.129295 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.130469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.131946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb7949-3bc6-4b6e-9c62-0c027f4c03fc None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.138339 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 59/120] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:23 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:24.138339 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.138339 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.138339 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.151493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:24.152665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:24.196024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498573a-371e-428d-8f43-9a25b57e46d1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.220646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 60/121] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:24.229081 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.229798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.230692 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.231175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.231690 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.232719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=ca013c31af4847a29ccf8f0c88da71c2) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:24.233291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.234919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.240666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 62/122] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/role_assignments?user.id=ca013c31af4847a29ccf8f0c88da71c2&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:24.248489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.333997 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039f8a3-e4ae-43a2-bbdb-df98f475e24c None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.357528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157592-bbc3-4d80-988b-3bcf8cc02abe None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.370777 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.371624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.371909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.372184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.383402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:24.392820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:24.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:24.394457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:24.395024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.395024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.395024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.395024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.396479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:24.396479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.398882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.399075 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 61/123] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:24.399944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.407331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 63/124] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:24.408075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.523338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6c00-b5c9-4b03-a70c-607f759ced95 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.527003 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bb63c-7e97-441c-8ff8-3b4d9205fa63 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.557124 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.557920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.558540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.558818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.571292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:24.576268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.577195 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.577482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.577762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/users/cc583517d7df4bf0b962b0fa96035dfb/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:24.579141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:24.580286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:24.581044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:24.581634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, user_id=cc583517d7df4bf0b962b0fa96035dfb, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.581704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 64/125] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:24.581704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.583920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.602969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 62/126] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:24 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/users/cc583517d7df4bf0b962b0fa96035dfb/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:24.604305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.756961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe52aaa-b303-44d5-bdc1-7852783b37c3 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.787248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a181f-e378-4814-859b-919bfa8f430f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:24.793557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.794448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.794731 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.795098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.796443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.797927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.799943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 63/127] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:24.800742 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.866315 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:24.866998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:24.867282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:24.867687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:24.868441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:24.868778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:24.870308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:24.878622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 65/128] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:24.879268 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:24.932670 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2fe63-1198-471d-b8bf-12026d04b9bb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.005247 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.005931 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.006223 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.006504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.007256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:25.007601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.009001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.029673 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 64/129] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.030621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.043192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f21b-3cea-472d-93c9-c95f60389642 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.089739 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.090610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.090900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.091183 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] PATH_INFO: `/v3/projects/242d31866225418caf5193a9fdbfaa2e` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.093089 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] RBAC: Authorizing `identity:get_project(project_id=242d31866225418caf5193a9fdbfaa2e)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.094552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.101003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 66/130] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:24 2022] GET /identity/v3/projects/242d31866225418caf5193a9fdbfaa2e => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.101831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.222913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8c58-10eb-4b6f-ae4b-8df3417e2430 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.256970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.257858 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.258144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.258424 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.259682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.261143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.262768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 65/131] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:25 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.263531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.289466 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ed92-a771-41fb-84a8-97e444937e6f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.324127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.325860 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.326556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.327233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.328666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.330588 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.332489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 67/132] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:25 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.333484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.431063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78c46-868e-4383-ae37-b1777abea10d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.442118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fe197-9775-4ad4-907d-6d81574b12ed None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.496411 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.497628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.498131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.498597 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.500057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.501699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.503957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 68/133] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:25 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.504914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.509445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.509874 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.510158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.510426 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] PATH_INFO: `/v3/projects/242d31866225418caf5193a9fdbfaa2e/users/cc583517d7df4bf0b962b0fa96035dfb/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.520242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=242d31866225418caf5193a9fdbfaa2e, user_id=cc583517d7df4bf0b962b0fa96035dfb, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.521708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.565851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 66/134] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:25 2022] PUT /identity/v3/projects/242d31866225418caf5193a9fdbfaa2e/users/cc583517d7df4bf0b962b0fa96035dfb/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:25.566454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.621713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592752-c601-4bd0-a0fd-480430178781 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.657157 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.658404 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.658882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.659387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.660865 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.662672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.664940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 69/135] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:25 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:25.675050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:25.845984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3310b5-dda8-4258-96f6-86b6c6122a21 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.866551 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92eb2-1ae3-4042-8466-3f9f72c33d00 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:25.894385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.895771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.896252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.896730 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/users/20792e246db94bf6a86a88130fe78b74/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.898908 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, user_id=20792e246db94bf6a86a88130fe78b74, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.902573 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638e012-a32c-47ed-9ea8-b50af349b43d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.922382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 70/136] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:25 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/users/20792e246db94bf6a86a88130fe78b74/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:25.931548 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:25.932593 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:25.933083 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:25.933427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/users/cc583517d7df4bf0b962b0fa96035dfb/roles/0dc581b2d2fc4530b12c23b1b965c984` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:25.936857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, user_id=cc583517d7df4bf0b962b0fa96035dfb, role_id=0dc581b2d2fc4530b12c23b1b965c984)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:25.938767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a483f0-cc5e-459f-811a-9ba13dbaf0c8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:25.956048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 67/137] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:25 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/users/cc583517d7df4bf0b962b0fa96035dfb/roles/0dc581b2d2fc4530b12c23b1b965c984 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:26.168702 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30881-8304-49e0-bf4e-3a250eba21e8 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:26.169382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30881-8304-49e0-bf4e-3a250eba21e8 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:26.169861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30881-8304-49e0-bf4e-3a250eba21e8 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:26.171424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 71/138] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:26.177881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:26.178511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:26.178985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:26.204495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:26.206301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:26.273871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 68/139] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:26.299399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30881-8304-49e0-bf4e-3a250eba21e8 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:26.445024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30881-8304-49e0-bf4e-3a250eba21e8 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:26.487020 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:26.487852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:26.488144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:26.488422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:26.489872 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:26.491304 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30440e-1fa1-4250-9c1a-fbbf128f4f11 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:26.493098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 72/140] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:26.498848 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:26.595856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f7c98-254d-4f03-815e-2d77b7d79e3d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:26.629356 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:26.630040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:26.630324 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:26.630605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:26.631319 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:26.632810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096e59-3c8a-40e4-86ae-c3e7c89f5a45 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:26.670737 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 69/141] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:26 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:27.233915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb564cfe-9686-48a3-9c70-a829b2748f13 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:27.234301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb564cfe-9686-48a3-9c70-a829b2748f13 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:27.234474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb564cfe-9686-48a3-9c70-a829b2748f13 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:27.236024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 73/142] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:27.241085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:27.241383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:27.241655 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:27.264362 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:27.265550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:27.336092 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 70/143] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:27.362587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb564cfe-9686-48a3-9c70-a829b2748f13 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:27.466565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb564cfe-9686-48a3-9c70-a829b2748f13 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:27.512214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:27.512952 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:27.513233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:27.513506 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:27.529248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:27.536969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:27.537818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:27.538565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 74/144] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:27.545753 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:27.664806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6112599-44a3-4c1a-af19-8e5273a3503f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:27.702200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:27.702878 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:27.703161 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:27.703462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:27.704215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:27.704520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:27.706187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:27.714926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 71/145] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:27.720646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:27.820427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0f77-6c45-4d18-86c2-00694195a3f9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:27.854655 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:27.855555 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:27.855839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:27.856111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] PATH_INFO: `/v3/users/ca013c31af4847a29ccf8f0c88da71c2` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:27.857316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] RBAC: Authorizing `identity:get_user(user_id=ca013c31af4847a29ccf8f0c88da71c2)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:27.858763 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:27.860597 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 75/146] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:27 2022] GET /identity/v3/users/ca013c31af4847a29ccf8f0c88da71c2 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:27.866256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:27.966142 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788935ce-8d03-4165-b207-296d78f79b17 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.000570 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.001430 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.001708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.001980 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.003238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:28.004721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c3d8e-0fdd-474d-a6f1-cdb970c89c1b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:28.006702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 72/147] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:27 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:28.012180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:28.085131 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a845-89c2-43fa-a774-776945eaf582 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.085438 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a845-89c2-43fa-a774-776945eaf582 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.085592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a845-89c2-43fa-a774-776945eaf582 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.087098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 73/148] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:28.093585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.093873 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.094154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.129346 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7b99-469b-4df9-856b-71bad933c334 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.133250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:28.135029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:28.213580 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.214486 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.214774 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.215057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/users/ca013c31af4847a29ccf8f0c88da71c2/roles/58a46c744cc74545bea7641b37e0dd0c` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.220699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, user_id=ca013c31af4847a29ccf8f0c88da71c2, role_id=58a46c744cc74545bea7641b37e0dd0c)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:28.222175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:28.226917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 74/149] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:28.251951 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 76/150] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:28 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/users/ca013c31af4847a29ccf8f0c88da71c2/roles/58a46c744cc74545bea7641b37e0dd0c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:28.264717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:28.387374 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d73f-7ae8-4815-8753-632c24b7dfe4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.426959 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.427808 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.428101 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.428382 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.445222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:28.454254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:28.455446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:28.456222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:28.459033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 75/151] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:28.472070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:28.612940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4956f-4503-49ee-ad28-6536aa3116bb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.652021 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.652654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.652930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.653202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.653946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:28.654249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:28.655727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:28.664665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 77/152] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:28.670010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:28.788206 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4902-b481-48a1-86e8-e98cceaefa32 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.825553 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.826479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.826774 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.827049 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:28.832243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:28.834061 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:28.835788 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 76/153] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:28 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:28.841338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:28.948367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6f4b-9ca9-4b51-9391-28c8a6549fb7 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:28.983858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637847-128e-4a4f-b485-739ef479186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:28.984515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637847-128e-4a4f-b485-739ef479186a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:28.984798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637847-128e-4a4f-b485-739ef479186a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:28.985071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637847-128e-4a4f-b485-739ef479186a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:29.055746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637847-128e-4a4f-b485-739ef479186a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:29.058031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637847-128e-4a4f-b485-739ef479186a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:29.174102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 78/154] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:29.179954 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:29.291804 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f535a3d-7a82-4417-bd0e-034e1341776d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:29.334705 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:29.335620 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:29.335908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:29.336174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:29.337473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:29.344299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e57db9-0f28-49c9-b84e-b05647d25ef4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:29.344299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 77/155] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:29 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:29.347195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637847-128e-4a4f-b485-739ef479186a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:29.457991 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637847-128e-4a4f-b485-739ef479186a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:29.497693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:29.498428 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:29.498624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:29.498896 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:29.499810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:29.500115 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:29.501586 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c79b-0810-45ca-a92b-d87785ac1d4d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:29.507647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 79/156] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:29 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:29.764031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1f10-d4c1-4707-a1ff-0d57e2d44056 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:29.764562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1f10-d4c1-4707-a1ff-0d57e2d44056 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:29.765071 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1f10-d4c1-4707-a1ff-0d57e2d44056 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:29.768213 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 78/157] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:29.774749 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77489-24ed-46a3-9070-f5283b356452 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:29.775445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77489-24ed-46a3-9070-f5283b356452 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:29.775962 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77489-24ed-46a3-9070-f5283b356452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:29.817047 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a8f77489-24ed-46a3-9070-f5283b356452 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:29.819143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a8f77489-24ed-46a3-9070-f5283b356452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:29.955150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 80/158] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:29.980927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d1f10-d4c1-4707-a1ff-0d57e2d44056 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.101488 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d1f10-d4c1-4707-a1ff-0d57e2d44056 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:30.137412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329411a9-5bbd-4b75-b16b-a26b1cc4c318 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.137713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329411a9-5bbd-4b75-b16b-a26b1cc4c318 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.137965 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329411a9-5bbd-4b75-b16b-a26b1cc4c318 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.139322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 81/159] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:30.145438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.145719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.145994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.161054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:30.161875 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.162197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.162471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.175775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:30.177648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:30.195914 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:30.212266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:30.213675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:30.214411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 79/160] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:30.253884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.310146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 82/161] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:30.356293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.428817 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2a30-d9e0-4086-80bc-ddb75117f71f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:30.561066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:30.562147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.562601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.563043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.564053 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:30.564573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:30.566180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:30.576397 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216c40-6f17-44d1-b6e3-5639b0ef6028 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:30.584482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 80/162] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:30.594180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.653967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:30.654715 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.655002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.655279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.692784 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:30.709541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:30.710575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:30.711336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 83/163] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:30.720383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.730307 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f7cd-2977-41a5-9e00-5c94c72bc40a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:30.781236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:30.782951 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:30.784972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:30.785484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:30.792397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:30.794129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:30.798007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 81/164] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:30 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:30.804905 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:30.988135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca13b-122a-48b2-a177-b6e95ecf3917 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.012709 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014233d-7dd8-4fa0-8dfa-51d2e5f063ed None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.052951 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.053621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.053905 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.054176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.158487 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.162749 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.163053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.163339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.164492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:31.164805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:31.166742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebfd94-0e12-4801-bee3-0540fa20a085 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:31.174877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:31.176365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:31.193544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 84/165] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:31.194733 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6682-8229-42b2-a5b4-ffd837cd7537 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.194991 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6682-8229-42b2-a5b4-ffd837cd7537 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.195268 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6682-8229-42b2-a5b4-ffd837cd7537 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.196756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 85/166] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:31.208718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.209017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.209222 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.251600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:31.251600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:31.288994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 82/167] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:31.293333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:31.393659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d7e6-ac8f-4dc4-be42-254f1d7b515c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.423040 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 86/168] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:31.423738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:31.438462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.439337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.439665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.439903 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] PATH_INFO: `/v3/users/cc583517d7df4bf0b962b0fa96035dfb` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.442575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=cc583517d7df4bf0b962b0fa96035dfb)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:31.444075 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:31.445698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 83/169] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/users/cc583517d7df4bf0b962b0fa96035dfb => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:31.452990 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:31.580645 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e8190-962b-4ed0-931e-22b4f56dc253 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.619142 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.620098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.620384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.620661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.621968 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:31.623435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:31.627548 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 87/170] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:31.628349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:31.676724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612db92-166a-483f-82db-af6742533ea4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.738803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.739488 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.739768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.740042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.745474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88068cc1-8af5-460d-b5d2-6748e9f8e21e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:31.786537 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:31.787336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.787640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.787920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.810238 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-5b07531b-61aa-46c5-878a-6697a59164b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:31.820554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:31.821442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:31.823017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 88/171] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:31.828377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93d77-c98f-4470-8f3b-73aedca6412d None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:31.828667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93d77-c98f-4470-8f3b-73aedca6412d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:31.828995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93d77-c98f-4470-8f3b-73aedca6412d None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:31.831258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 89/172] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:31.831790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93d77-c98f-4470-8f3b-73aedca6412d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:31.836157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:31.837677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:31.955503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 84/173] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:31.956369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.020837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93d77-c98f-4470-8f3b-73aedca6412d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.102988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.103722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.104006 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.104276 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.105102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] RBAC: Adding query filter params (role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:32.105406 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.106849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff8bf-e543-42fe-a72c-2eb258f4cfe9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.122203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 90/174] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:32.123435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.123667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.126489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.151476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d47a2-6b8f-4047-a2fc-7aa1bc326e25 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.165229 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:32.166467 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:32.221920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.222657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.222938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.224458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.225240 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:32.225550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.227925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.248404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 85/175] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:32.249285 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.305313 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 91/176] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:32.313279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.389182 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ba5b4-4bda-410d-a9e2-72ffec762b14 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.433271 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.434154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.434436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.434708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] PATH_INFO: `/v3/projects/242d31866225418caf5193a9fdbfaa2e` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.439753 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] RBAC: Authorizing `identity:get_project(project_id=242d31866225418caf5193a9fdbfaa2e)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.441344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.443166 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 86/177] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/projects/242d31866225418caf5193a9fdbfaa2e => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:32.444041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.496274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8af1d-bbbf-4484-a78b-49b40980c82d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.542027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.543319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.543871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.544347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] PATH_INFO: `/v3/users/20792e246db94bf6a86a88130fe78b74` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.547168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=20792e246db94bf6a86a88130fe78b74)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.548852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3877f1-edba-4cf8-9294-85919ed9d5e9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.550696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 92/178] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/users/20792e246db94bf6a86a88130fe78b74 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:32.552118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59864-7cb6-4905-8dbd-cb54294af768 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.552617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59864-7cb6-4905-8dbd-cb54294af768 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.553188 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59864-7cb6-4905-8dbd-cb54294af768 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.559379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 93/179] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:32.559573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94077-55b2-4259-bfbf-b771a19064f4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.560767 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59864-7cb6-4905-8dbd-cb54294af768 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.594845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.596531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.596531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.596531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.612248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:32.620499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:32.621478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:32.622256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 87/180] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:32.622882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.701459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d59864-7cb6-4905-8dbd-cb54294af768 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.726415 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718490-9cd3-47ff-83b6-83ced75a6543 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.739190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.739872 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.740150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.740422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.741240 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=242d31866225418caf5193a9fdbfaa2e, user.id=cc583517d7df4bf0b962b0fa96035dfb) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:32.741542 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.742960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ed39-921a-448e-8f6e-3b687fa48eb8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.749107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 94/181] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/role_assignments?user.id=cc583517d7df4bf0b962b0fa96035dfb&scope.project.id=242d31866225418caf5193a9fdbfaa2e&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:32.750239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.750517 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.750784 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.767471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:32.768704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:32.771138 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.771928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.772214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.772489 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.840653 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 95/182] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:32.851624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.855531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.858087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f8bc7-9fbb-4c73-9dfc-49b1000b9114 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:32.947989 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f61844-709f-4543-816b-4600a434b8c0 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:32.971048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 88/183] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:32.972125 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58395-1646-4515-93c9-2cc83843cc26 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.972125 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58395-1646-4515-93c9-2cc83843cc26 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.972324 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58395-1646-4515-93c9-2cc83843cc26 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.973558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 89/184] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:32.974617 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe73ec-e849-4a1e-89f3-0362727f0a6b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.974897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe73ec-e849-4a1e-89f3-0362727f0a6b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.975170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe73ec-e849-4a1e-89f3-0362727f0a6b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.977400 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 90/185] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:32.979993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe73ec-e849-4a1e-89f3-0362727f0a6b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:32.989457 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:32.990131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:32.990431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:32.990679 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:32.991456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:32.991762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:32.993145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.002308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 96/186] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.003019 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.085748 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe73ec-e849-4a1e-89f3-0362727f0a6b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.096767 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527669-cfd2-4934-b11d-74f8f21e3430 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.122624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.123532 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.123811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.124083 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.125224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.126662 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a4a6-764c-4bcb-8796-e57732f5aa55 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.128334 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 91/187] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.129447 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.129711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.129854 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.129987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.130941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.131388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.131870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.133290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.135332 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbfae-8bc8-4654-9f00-74eca7f84287 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.141474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 97/188] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.141474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.141474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.141474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.146489 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:33.147686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:33.154260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:33.155431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:33.208888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 92/189] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:33.209701 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.219644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 98/190] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:33.229846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.301168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039ba57-4d1e-440e-8d71-5d4761f5c42e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.321419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97a60-00e6-4ed1-90d7-8f27dc36d416 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.334349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.335215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.335589 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.335869 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.348852 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.350315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.352102 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 93/191] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.353022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.357742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.358408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.358686 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.358957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.359702 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.361238 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.381082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 99/192] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:33 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:33.382051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.458250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64979d60-09b8-4a9f-a82f-666ae595fea6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.497093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.497672 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.497985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.498261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.498515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553f917-7af6-4fa0-8ef6-5beebfc8da90 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.499097 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=20792e246db94bf6a86a88130fe78b74) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:33.499437 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.500911 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.514548 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 94/193] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/role_assignments?user.id=20792e246db94bf6a86a88130fe78b74&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=df86ea59d76740488f867f6211ccfa28 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.514548 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.545894 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.547014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.548308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.548593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.564117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:33.575444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:33.576381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:33.577155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 100/194] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:33.577925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.637295 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbed-2463-479c-9674-c7408dcd095a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.692547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0ca4-feaa-4f13-81d1-50c717e8407b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.694696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.696636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.696930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.697204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.709244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:33.718557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:33.719560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:33.720360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:33.720947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 95/195] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:33.721521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.733517 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.734857 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.735338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.735873 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.808707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.810196 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.839953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6414-ddda-4791-9e79-09d68bb1cb48 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:33.880407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:33.881140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:33.881348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:33.881622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:33.882364 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:33.882665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:33.884071 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:33.893375 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 96/196] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:33.894205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.928974 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 101/197] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:33.930641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:33.995124 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e405-35d7-47b9-a089-060016488616 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.028839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.029677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.030055 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.030432 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.031274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:34.031722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.033205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.042101 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 97/198] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.043010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.044271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f88c3-8d44-45a3-8330-edb78ed4ee0f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.080729 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.081578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.081863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.082139 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.083421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.084931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.086670 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 102/199] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:33 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.087746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.148258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e9e31-ee36-4777-b0a9-ff163a0ad2ee None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.183229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.184199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.184535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.184813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.186200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.187678 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.189781 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 98/200] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.190619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.202153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b9e8d-03b3-4c33-aa5a-89206a2896b4 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.246911 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.248202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.248648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.248930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] PATH_INFO: `/v3/users/ca013c31af4847a29ccf8f0c88da71c2` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.250740 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] RBAC: Authorizing `identity:get_user(user_id=ca013c31af4847a29ccf8f0c88da71c2)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.252838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.254969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 103/201] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/users/ca013c31af4847a29ccf8f0c88da71c2 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.256050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.289427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ef8-1f0a-401a-ac85-b160da913f4a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.332906 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.333485 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.333922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.334211 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.369184 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daf7cd-201e-43e3-91a4-32d1c7224f32 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.402956 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.403816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.404200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.404566 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.405488 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=37dcb81565c4496186bf035036a51601) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:34.405903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.407460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.413393 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 104/202] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/role_assignments?user.id=37dcb81565c4496186bf035036a51601&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=df86ea59d76740488f867f6211ccfa28 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.414134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.417439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.419910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.547508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599da8-0853-4555-8b70-002c0453582e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.618755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.619328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.619632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.619940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.635734 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 99/203] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:34.642067 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.698509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.700255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.805082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 105/204] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:34.811309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:34.882834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8fe28-0490-4f32-9aba-86f1dc61efc7 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:34.927426 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:34.928290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:34.928573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:34.928843 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:34.930632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:34.932143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:34.933842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 100/205] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:34.939913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:35.016033 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60334ed2-fb56-4459-9e80-a1ca6f9cc7f4 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:35.074422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:35.075273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:35.075576 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:35.075848 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:35.077066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:35.078511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:35.080497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 106/206] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:35.086246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:35.113243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ddd3f-3ffb-4df0-97e8-fb46d6e0e142 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:35.176321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:35.177416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:35.177941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:35.178465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:35.184496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] RBAC: Adding query filter params (role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=37dcb81565c4496186bf035036a51601) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:35.185049 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:35.186569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588a98-8395-41ce-9b15-5c660fef90d9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:35.207546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 101/207] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:34 2022] GET /identity/v3/role_assignments?user.id=37dcb81565c4496186bf035036a51601&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:35.246617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ef8e-eb58-436b-9eb2-0cfee8283d3c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:35.290428 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:35.291096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:35.291398 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:35.291682 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:35.292526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, scope.project.id=24a91388961c479f81705073f3551c6f, user.id=ca013c31af4847a29ccf8f0c88da71c2) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:35.292840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:35.294416 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98546fd1-0a7e-4f14-aee7-60b665b4efea None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:35.301238 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 107/208] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:35 2022] GET /identity/v3/role_assignments?user.id=ca013c31af4847a29ccf8f0c88da71c2&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:36.186272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42abc6-66ac-4712-9741-6b6728fbdf4e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.187281 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42abc6-66ac-4712-9741-6b6728fbdf4e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.187819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42abc6-66ac-4712-9741-6b6728fbdf4e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.189423 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 102/209] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:36.194885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.195723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.196197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.201994 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e26a8-48f9-4cf6-bbf3-b0b892eec21d None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.202527 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e26a8-48f9-4cf6-bbf3-b0b892eec21d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.202999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e26a8-48f9-4cf6-bbf3-b0b892eec21d None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.205078 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 103/210] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:36.211688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.213255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.213781 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.218467 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:36.220030 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:36.235165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:36.237007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:36.295375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 108/211] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:36.313504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:36.318309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.345473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.420510 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd5924-8ff2-4388-a474-95d7a7292544 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:36.443106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ba52-4ea2-405e-a5d7-8300e5e95e04 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:36.455632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:36.456727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.457203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.457694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.478833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:36.479654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.479936 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.480209 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.481394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:36.482856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:36.483485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:36.489050 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 105/213] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:36.489986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:36.497226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:36.498100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:36.498883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 109/214] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:36.506330 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.593802 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884421-2dab-4c24-a396-b242c4af2f87 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:36.630143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:36.631129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.631617 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.632060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.632936 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:36.635214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:36.640563 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267bed-3c56-4b35-86da-e71127675a9d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:36.664628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 106/215] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:36 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:36.685491 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:36.686626 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.687147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.687645 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.688617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:36.689138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:36.690834 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0aff7-9bfd-48a1-9721-916b8555b53e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:36.701680 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 110/216] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:36.710261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.824754 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8183-463c-41e2-97de-dc85cdef29dd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:36.847214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c8e9-8de5-48a9-b25d-e9296671598b None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.847557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c8e9-8de5-48a9-b25d-e9296671598b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.847829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c8e9-8de5-48a9-b25d-e9296671598b None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.849498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 111/217] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:36.854482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.855082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.855082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.872604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:36.873431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:36.873716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:36.873989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] PATH_INFO: `/v3/users/6862617e37bb4a24baa56c4e805a1683` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:36.874228 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:36.876239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:36.888437 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] RBAC: Authorizing `identity:get_user(user_id=6862617e37bb4a24baa56c4e805a1683)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:36.889926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:36.896519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 107/218] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/users/6862617e37bb4a24baa56c4e805a1683 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:36.897383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:36.967446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 112/219] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:36.986280 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.028597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a83f-b570-4cfe-b16a-8d5efbeb337a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.077048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.077955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.078088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.078427 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.115069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c978e-b2be-45a7-8556-509a97964209 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.152522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.153440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.153760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.154034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.159314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.160902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.166804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:37.176592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:37.177501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:37.178289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 113/220] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:37.184742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.267563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 108/221] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 16:49:37.278369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.285350 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccad60-a167-4e77-ab58-f4143cc61976 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.321833 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.322878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.323165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.323482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.324212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:37.324512 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.325902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.335904 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 114/222] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:37.341672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.455673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031dae6-57e7-483d-a015-24acf219e0e3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.497831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e46-d816-4bf0-b174-3fd4514d3006 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.528689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.529486 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.529763 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.530034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.532261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.533703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.535329 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 115/223] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:37 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:37.542125 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.559770 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.560672 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.560949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.561218 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.562421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.563900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.565588 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 109/224] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:37 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:37.572954 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.713569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62da38a-8ef3-4e59-88d1-404c19dd8b05 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.739452 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475559c-eaac-4435-a3a9-786c5124c0bc None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:37.756907 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.757563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.757844 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.758113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.758947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=6862617e37bb4a24baa56c4e805a1683) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:37.759293 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.762023 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.775803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 110/225] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:37 2022] GET /identity/v3/role_assignments?user.id=6862617e37bb4a24baa56c4e805a1683&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:37.799132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:37.799959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.800236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.800507 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.801711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:37.803165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6066b-ae53-4a33-afed-75bc3ca8a0d6 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:37.805185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 116/226] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:37 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:37.811039 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:37.846796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc805-af82-4cf1-a747-2237509be568 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.847140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc805-af82-4cf1-a747-2237509be568 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.847343 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc805-af82-4cf1-a747-2237509be568 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.848877 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 117/227] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:37.855260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:37.855570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:37.855821 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:37.888627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:37.889845 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:38.003386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486f5b-442f-4e21-9086-52fa9c0505dd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:38.069087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 118/228] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:38.092143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:38.093059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:38.093344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:38.093617 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/37dcb81565c4496186bf035036a51601/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:38.095714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, user_id=37dcb81565c4496186bf035036a51601, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:38.097168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:38.113557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:38.154965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 111/229] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:37 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/37dcb81565c4496186bf035036a51601/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:38.331143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8537-bb84-4560-872e-c109cc2767dd None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:38.380495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:38.381317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:38.381598 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:38.381870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:38.398169 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:38.406762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:38.408923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:38.410837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 119/230] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:38.418274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:38.528590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943393-9e3c-41e2-af56-7863fc51e947 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:38.566312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:38.566996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:38.567278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:38.567574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:38.568324 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:38.568627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:38.570006 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:38.579263 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 112/231] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:38.585985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:38.753433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3eda-5a96-4a0b-bbbf-989bb52d60f9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:38.798424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:38.799296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:38.799595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:38.799872 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:38.801063 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:38.802510 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:38.804317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 120/232] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:38 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:38.809831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:38.909711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a861a2-81da-4f41-893a-ce6955370e48 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:38.944508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:38.945364 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:38.945647 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:38.945919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:38.947651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:38.949107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455b10-f7b1-4d17-8a12-9f5ae507ab59 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:38.950958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 113/233] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:38 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:38.956639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:39.078938 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286c0f-a224-43ed-901d-2396e143e79c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:39.117593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:39.119242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:39.119721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:39.120135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/37dcb81565c4496186bf035036a51601/roles/0dc581b2d2fc4530b12c23b1b965c984` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:39.122569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, user_id=37dcb81565c4496186bf035036a51601, role_id=0dc581b2d2fc4530b12c23b1b965c984)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:39.124194 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af31cd-e5ea-4430-8816-158f69c75b8b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:39.145381 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 121/234] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:38 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/37dcb81565c4496186bf035036a51601/roles/0dc581b2d2fc4530b12c23b1b965c984 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:39.852887 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39478e-57ec-4256-9c3c-c8b2568c2b10 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:39.853760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39478e-57ec-4256-9c3c-c8b2568c2b10 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:39.854209 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39478e-57ec-4256-9c3c-c8b2568c2b10 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:39.856050 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 114/235] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:39.873601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:39.874525 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:39.874994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:39.896309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:39.897803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:39.925557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fca8-9fa2-4628-8820-b2d64c724834 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:39.926179 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fca8-9fa2-4628-8820-b2d64c724834 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:39.926510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fca8-9fa2-4628-8820-b2d64c724834 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:39.928085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 115/236] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:39.939496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:39.940163 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:39.940723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:39.958017 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:39.959535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:40.003859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 122/237] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:40.029322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.091154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 116/238] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:40.155213 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.185919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1866af9-6b4b-41b3-ac53-9151da85d0d6 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.221547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.222340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.222624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.222899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.224109 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:40.225562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:40.227270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 123/239] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:40.238946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.329549 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c9f6-e116-49cc-be28-5023a9fa9b54 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.366833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.367896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.369212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.369788 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.382305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:40.391129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:40.392309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:40.393201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:40.396294 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 117/240] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:40.408494 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.426386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec7-10c3-492e-a0a7-4894af96b643 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.480070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.480753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.481033 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.481306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.482020 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:40.483474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:40.513637 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dfde0-3753-4879-a995-5847d364ea69 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.522772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 124/241] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:40 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:49:40.561433 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.562482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.562967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.563499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.564473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:40.565010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:40.566784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd93e-a701-4c0f-bd5d-9a2715a852b8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:40.576735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 118/242] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:40.583196 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.629529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d731-c3ca-4df7-8088-75092c451985 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.630099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d731-c3ca-4df7-8088-75092c451985 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.630556 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d731-c3ca-4df7-8088-75092c451985 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.632150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 119/243] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:40.637473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162816c-6896-4123-b718-0fe49332e116 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.638099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162816c-6896-4123-b718-0fe49332e116 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.638594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162816c-6896-4123-b718-0fe49332e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.663903 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d162816c-6896-4123-b718-0fe49332e116 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:40.665962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d162816c-6896-4123-b718-0fe49332e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:40.705014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758945b0-dd0a-4e06-8477-36fa2aa4d624 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.743390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 120/244] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:40.750038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.751316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.751823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.752328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] PATH_INFO: `/v3/users/df2770e6d9604202b8cf198bda3822d1` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.779105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] RBAC: Authorizing `identity:get_user(user_id=df2770e6d9604202b8cf198bda3822d1)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:40.781993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:40.789441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 125/245] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/users/df2770e6d9604202b8cf198bda3822d1 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:40.791917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162816c-6896-4123-b718-0fe49332e116 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.803857 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:40.920005 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162816c-6896-4123-b718-0fe49332e116 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.930101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632edf99-1976-4401-bb9e-2ec5371b7e58 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:40.969291 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.970328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.970526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:40.971012 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.971303 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:40.971617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:40.971891 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.972121 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:40.983706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:40.992984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:40.993906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:40.999083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 126/246] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:41.002619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.066169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.068233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d93faf-1923-44cc-8665-0fff4563398f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.120607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd2e4-4db3-49a6-8e8e-08725685c1a5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.168114 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.168898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.169182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.169460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.170269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:41.170526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.171975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f74733-78b4-4455-8e19-8a15c2426738 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.181336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 127/247] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:41.182496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b54b-2a80-4335-9c53-199028e15868 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.182791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b54b-2a80-4335-9c53-199028e15868 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.183069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b54b-2a80-4335-9c53-199028e15868 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.186508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 128/248] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:41.190425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741b54b-2a80-4335-9c53-199028e15868 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.207924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 121/249] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:41.209227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.209516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.209788 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.227811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:41.229384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:41.307626 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741b54b-2a80-4335-9c53-199028e15868 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.318862 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 122/250] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:41.323881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.347925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.349140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.349621 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.350137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] PATH_INFO: `/v3/users/6862617e37bb4a24baa56c4e805a1683` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.351542 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] RBAC: Authorizing `identity:get_user(user_id=6862617e37bb4a24baa56c4e805a1683)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.353773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.356321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 129/251] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/users/6862617e37bb4a24baa56c4e805a1683 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:41.361745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.454436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa8f5-a5be-4fda-a3bc-93ae6b9bbe6b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.500923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52652eb-4c75-4166-8e83-72650f3dc85a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.534504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.535439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.535722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.535995 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.537284 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.538764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.540771 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 123/252] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:41.541326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.567859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.568830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.569112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.569392 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.571014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.573302 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.577231 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 130/253] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:41.577794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.677835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e1fc-048f-4160-9c27-6e4eb2d68975 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.715020 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.715919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.716204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.716484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.728619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:41.738107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:41.739014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:41.740314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 124/254] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:41.741227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.765197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1a68-3770-4d27-be71-211c70ba1a72 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.818449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.819107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:41.819403 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:41.819677 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:41.820502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=df2770e6d9604202b8cf198bda3822d1) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:41.820809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:41.822272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:41.828738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 131/255] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/role_assignments?user.id=df2770e6d9604202b8cf198bda3822d1&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:41.829324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:41.935490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19589-70b5-464f-808a-2897c26b1907 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:41.999013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:41.999876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.000157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.000327 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c3e69-3ed4-4ddb-8e4f-698d3fa0f890 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:42.000813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/6862617e37bb4a24baa56c4e805a1683/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.002398 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, user_id=6862617e37bb4a24baa56c4e805a1683, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:42.003901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:42.036574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:42.037254 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.037633 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.037914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.038816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:42.039375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:42.041588 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c72fd-11d6-488c-ba57-f226f787b1f4 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:42.050235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 125/256] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:41 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/6862617e37bb4a24baa56c4e805a1683/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:42.054006 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 132/257] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:42.060291 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.070727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b0d-da38-4b44-902c-bf9baa088964 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.071048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b0d-da38-4b44-902c-bf9baa088964 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.071284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b0d-da38-4b44-902c-bf9baa088964 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.072861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 133/258] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:42.080923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.081251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.081541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.103640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:42.104967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:42.230384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 134/259] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:42.248332 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35a3ac-704e-49cd-b9b1-cbf824ac05e4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:42.286125 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:42.286933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.287280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.287558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.288687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.297528 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:42.299062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:42.303379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 126/260] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:42.325804 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.469316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896ec5-c805-4d5a-986b-44469a143867 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:42.508096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc8a4-6cbe-41c3-8a6a-7ba43916c15f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:42.538052 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:42.538778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.539061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.539335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.557773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:42.569056 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:42.569719 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.569985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.570257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:42.573427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:42.575529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:42.577501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:42.580561 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 135/261] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:42.588521 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.699210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:42.701805 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:42.771377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc72e-5e58-43c9-ad50-4a4ca1604396 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:42.844132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:42.844879 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:42.845263 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:42.845647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:42.846501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:42.846931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:42.848449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:42.862753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 136/262] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:42.868260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.883597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 127/263] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 16:49:42.889257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:42.999814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05a0d-b2a4-417c-8d79-54b061c4b7d5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.033897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.034760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.035044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.035324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] PATH_INFO: `/v3/users/37dcb81565c4496186bf035036a51601` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.037594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=37dcb81565c4496186bf035036a51601)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.039045 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.041449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 137/264] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/users/37dcb81565c4496186bf035036a51601 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:43.050131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:43.071786 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee8b0-1295-4f93-b3a8-e7733bf472f3 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.130605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.131820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.132321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.132810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.134731 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.136418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.139195 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 128/265] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:42 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:43.145629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:43.259501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e40-35bb-407f-92e0-5974f380b4f7 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.261837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7a966-bbd4-412e-944d-afe24ccb6ebd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.329960 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.331816 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.332792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.333601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.334098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.335135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=37dcb81565c4496186bf035036a51601) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:43.335993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.336484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.337555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.338022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.340693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.357090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 129/266] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:43 2022] GET /identity/v3/role_assignments?user.id=37dcb81565c4496186bf035036a51601&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=df86ea59d76740488f867f6211ccfa28 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:43.454273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.456061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.602071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:43.607833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:43.717044 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576325c4-8700-41ea-93aa-631fa14de570 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.751382 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.752613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.753096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.753568 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.754971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.756651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a21432-cd38-4ffd-b996-0ce4c41c8b0a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.758908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 130/268] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:43 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:43.765116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:43.900627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2aa22-02d6-443b-aa44-7f87bb7299bf None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:43.939365 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:43.940024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:43.940307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:43.940578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:43.941402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] RBAC: Adding query filter params (role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=37dcb81565c4496186bf035036a51601) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:43.941704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:43.943131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856568-a287-4206-9bca-b52c6718f580 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:43.949283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 139/269] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:43 2022] GET /identity/v3/role_assignments?user.id=37dcb81565c4496186bf035036a51601&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:44.028474 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d700b5-6b0d-4474-bf30-4db001288f8c None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.028767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d700b5-6b0d-4474-bf30-4db001288f8c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.028961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d700b5-6b0d-4474-bf30-4db001288f8c None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.030664 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 131/270] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:44.036825 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.037326 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.037398 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.055272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:44.057065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:44.150632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 140/271] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:44.186814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d700b5-6b0d-4474-bf30-4db001288f8c None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:44.292494 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d700b5-6b0d-4474-bf30-4db001288f8c None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:44.325628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:44.326422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.326709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.326991 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.328292 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:44.330010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb996a-5268-4eb9-902e-8e64c8cd0208 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:44.331896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 132/272] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:44.337829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:44.351014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5359db-0ec8-484d-bb05-3abdc6d515cf None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.351014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5359db-0ec8-484d-bb05-3abdc6d515cf None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.351014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5359db-0ec8-484d-bb05-3abdc6d515cf None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.353671 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 133/273] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:44.359940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.363860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.364203 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.384266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:44.385501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:44.479415 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 134/274] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:44.482160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fae89-b4fc-4ced-a532-a680a27210bd None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:44.515111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:44.534933 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:44.536010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.536490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.536958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.537869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:44.541405 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:44.564364 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 141/275] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:49:44 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:44.635995 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feb97a-5950-42cd-9b3b-c23171855648 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:44.674071 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:44.675287 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.675826 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.676298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.688699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:44.697765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:44.698733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:44.699535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:44.702118 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 135/276] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:44.708774 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:44.810727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31f548-9a8f-4fcd-b65d-2fc6baac474c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:44.846091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:44.847130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:44.847681 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:44.848154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:44.849104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:44.849606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:44.851207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:44.860615 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 142/277] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:44.865695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:44.973212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472b6-f892-4d74-a637-8da0a7eac5bd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.007066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.008517 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.009495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.009913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] PATH_INFO: `/v3/users/fd16f7cf0f224e68a2c5efb3f2810550` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.024803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] RBAC: Authorizing `identity:get_user(user_id=fd16f7cf0f224e68a2c5efb3f2810550)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:45.026534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cae26b-4401-4d8a-af57-8bd6f2e882aa None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:45.028425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 136/278] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:44 2022] GET /identity/v3/users/fd16f7cf0f224e68a2c5efb3f2810550 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:45.034946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.142678 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7adfb-8b47-4ddc-9087-28c0f4865b7f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.142857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7adfb-8b47-4ddc-9087-28c0f4865b7f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.143116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf0eb1-2d87-4fd6-bef5-d676ffa8b6b2 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.143592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7adfb-8b47-4ddc-9087-28c0f4865b7f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.145975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 137/279] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:45.150227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f7aa-3212-4d12-98e6-f3483d8f79a3 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.150519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f7aa-3212-4d12-98e6-f3483d8f79a3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.150806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f7aa-3212-4d12-98e6-f3483d8f79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.170105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8369f7aa-3212-4d12-98e6-f3483d8f79a3 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:45.172555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8369f7aa-3212-4d12-98e6-f3483d8f79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:45.195084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.195779 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.196068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.196424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.197752 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, user.id=fd16f7cf0f224e68a2c5efb3f2810550, scope.system=all) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:45.198067 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:45.199549 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:45.211535 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 143/280] 10.222.0.58 () {56 vars in 1308 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/role_assignments?user.id=fd16f7cf0f224e68a2c5efb3f2810550&scope.system=all&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:45.255772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 138/281] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:45.304938 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.313960 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce69-06d9-4574-bce4-def0791abd50 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.314272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce69-06d9-4574-bce4-def0791abd50 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.314526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce69-06d9-4574-bce4-def0791abd50 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.316250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 139/282] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:45.322699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.322699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.322930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.342129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:45.343344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:45.437898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898128-218c-4c77-922f-7b53b336cd7d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.471388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 140/283] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:45.474808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.474808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.474808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.474808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.485172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:45.493061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:45.494505 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:45.495279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:45.499460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 144/284] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:45.504453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.504731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.642640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c807a0-40b4-4b9c-be7b-824c72fdb72b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.677876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.678984 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.680261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.681855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.682973 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:45.685008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40bc0-fbc8-41e4-b9e4-9a89a4552721 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.686927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:45.688631 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:45.705917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 141/285] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:45.710475 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.749828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.751072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.751586 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.752060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.769007 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:45.777953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:45.778921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:45.779743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:45.782443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 145/286] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:45.788206 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.902589 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147921-008a-4a8e-b21d-daa7de4e75fa None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.928574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087986-5d86-4339-9517-bafdedfb53dc None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:45.958850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.961248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.963111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.966180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] PATH_INFO: `/v3/users/6862617e37bb4a24baa56c4e805a1683` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:45.968635 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] RBAC: Authorizing `identity:get_user(user_id=6862617e37bb4a24baa56c4e805a1683)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:45.971615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:45.974137 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 142/287] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/users/6862617e37bb4a24baa56c4e805a1683 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:45.980444 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:45.997137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:45.998189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:45.998699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:45.999171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.000147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:46.002127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.003752 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.017487 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 146/288] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:46.023658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:46.133463 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03d55-3ccb-4868-be09-4131a1456084 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.182300 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab215f9-46bb-4cae-b4f1-4b9f57254efc None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.189147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.190731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.194400 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.194917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] PATH_INFO: `/v3/users/df2770e6d9604202b8cf198bda3822d1` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.196954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] RBAC: Authorizing `identity:get_user(user_id=df2770e6d9604202b8cf198bda3822d1)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.199238 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.201511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 147/289] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:46 2022] GET /identity/v3/users/df2770e6d9604202b8cf198bda3822d1 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:46.207778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:46.268167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.268850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.269036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.269305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.361018 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b5e0a-9466-4b3b-9a5e-632a10851204 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.365965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.367451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.437044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.437961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.438252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.438533 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.439781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.441220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.442932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 148/290] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:46 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:46.450363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:46.471324 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 143/291] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:46.481685 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:46.587550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d882f55-ea13-4f99-bbc6-7d3c0dc16518 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.628884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.629745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.630024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.630298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.634335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.635821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.637669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 144/292] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:46 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:46.648453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:46.705756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19004-1ca3-4032-9213-79b53081434f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.751812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994d94f-6a21-4c3d-bc50-b618ae92abf4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:46.774826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.775809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.776094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.776371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/df2770e6d9604202b8cf198bda3822d1/roles/58a46c744cc74545bea7641b37e0dd0c` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.778440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, user_id=df2770e6d9604202b8cf198bda3822d1, role_id=58a46c744cc74545bea7641b37e0dd0c)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.779929 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9e459-7d1d-4e1a-8f24-3ebfcdfe12f3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.793282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:46.794367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:46.794852 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:46.795328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:46.796653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=6862617e37bb4a24baa56c4e805a1683) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:46.797169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:46.798923 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7215-098b-4582-a27e-777cc003e558 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:46.807305 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 145/293] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:46 2022] GET /identity/v3/role_assignments?user.id=6862617e37bb4a24baa56c4e805a1683&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:46.823296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 149/294] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:49:46 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/users/df2770e6d9604202b8cf198bda3822d1/roles/58a46c744cc74545bea7641b37e0dd0c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:49:47.526396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07624dc-c386-4c28-a0c6-16b1b3d1a14e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.527368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07624dc-c386-4c28-a0c6-16b1b3d1a14e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.527874 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07624dc-c386-4c28-a0c6-16b1b3d1a14e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.529706 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 146/295] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:47.534744 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ee0e-1e56-4426-9cc0-7b23edd3fbf4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.535155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ee0e-1e56-4426-9cc0-7b23edd3fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.535325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ee0e-1e56-4426-9cc0-7b23edd3fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.553308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-be01ee0e-1e56-4426-9cc0-7b23edd3fbf4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:47.554531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-be01ee0e-1e56-4426-9cc0-7b23edd3fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:47.634876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 150/296] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:47.660197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07624dc-c386-4c28-a0c6-16b1b3d1a14e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:47.757377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e0c-e770-48e8-86cb-fafbc7ad5d86 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.757559 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e0c-e770-48e8-86cb-fafbc7ad5d86 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.757835 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e0c-e770-48e8-86cb-fafbc7ad5d86 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.759992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 151/297] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:47.764947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07624dc-c386-4c28-a0c6-16b1b3d1a14e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:47.765076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b571-f759-4088-a8f4-96689e64d1cf None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.765277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b571-f759-4088-a8f4-96689e64d1cf None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.765513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b571-f759-4088-a8f4-96689e64d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.782023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-ae08b571-f759-4088-a8f4-96689e64d1cf None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:47.783239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-ae08b571-f759-4088-a8f4-96689e64d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:47.807251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:47.808091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.808372 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.808644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.818846 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-fbb92cd0-8743-4f9b-b65f-d37a216439a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:47.827089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:47.828152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:47.828928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 147/298] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:47.829558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ffe21-d338-4219-bbd5-20f3b922e4e4 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.830347 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ffe21-d338-4219-bbd5-20f3b922e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.830347 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ffe21-d338-4219-bbd5-20f3b922e4e4 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.835396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 148/299] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:47.835396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ffe21-d338-4219-bbd5-20f3b922e4e4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:47.857918 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 152/300] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:47.860723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.861016 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.861298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.880571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:47.882130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:47.945238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ffe21-d338-4219-bbd5-20f3b922e4e4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:47.950105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 153/301] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:47.951009 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:47.981949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:47.982616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:47.982901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:47.983178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:47.983969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:47.984277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:47.985663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:47.993870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 149/302] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:47.996416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.062760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f719a-16ee-42fb-99c1-9b2cbbd87a1c None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.092965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31ca0a-aaa3-438c-a7eb-7cc7ad8ca0f1 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.096084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.096861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.097144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.097430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.098574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.100058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.101661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 154/303] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:48.106746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.133541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.135093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.135536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.135944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.145608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:48.153451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:48.154463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:48.155449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:48.161299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 150/304] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:48.161299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.212324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f6e3-1102-4e1e-b9de-523d975fd237 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.245711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.246591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.246859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.247140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] PATH_INFO: `/v3/users/37e178aa39414dc499a467ba617d45fa` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.261540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] RBAC: Authorizing `identity:get_user(user_id=37e178aa39414dc499a467ba617d45fa)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.263000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.263676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a03a8-b42b-440d-a63e-fda9377f466b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.264898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 155/305] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:48 2022] GET /identity/v3/users/37e178aa39414dc499a467ba617d45fa => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:48.265498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.299651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.300322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.300609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.300890 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] PATH_INFO: `/v3/groups` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.301578 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.303019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.317590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 151/306] 10.222.0.58 () {60 vars in 1134 bytes} [Wed May 11 16:49:48 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:49:48.318318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.385583 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0765-893a-4741-91ff-f27806fedd61 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.424499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.425059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.425358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.425639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.426484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:48.426796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.428230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.438051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 156/307] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:48.444178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.446345 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9ef-216a-4a05-8153-d090ba5ed27e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.496640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.497860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.498286 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.498700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.500254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, user.id=37e178aa39414dc499a467ba617d45fa, scope.system=all) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:48.500721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.502808 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.510281 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 152/308] 10.222.0.58 () {56 vars in 1308 bytes} [Wed May 11 16:49:48 2022] GET /identity/v3/role_assignments?user.id=37e178aa39414dc499a467ba617d45fa&scope.system=all&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:48.561937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b34de-6fec-4766-ab49-59ad31862161 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.604661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.605830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.606311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.606706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] PATH_INFO: `/v3/users/fd16f7cf0f224e68a2c5efb3f2810550` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.609197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] RBAC: Authorizing `identity:get_user(user_id=fd16f7cf0f224e68a2c5efb3f2810550)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.610674 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcb593-2f35-4674-830f-ab2ed58d70bc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.612766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 157/309] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:48 2022] GET /identity/v3/users/fd16f7cf0f224e68a2c5efb3f2810550 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:48.619855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:48.729824 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc332-c07a-48dd-9706-50effd4023dd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:48.763451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:48.764301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:48.764582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:48.764851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] PATH_INFO: `/v3/system/users/fd16f7cf0f224e68a2c5efb3f2810550/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:48.766327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd16f7cf0f224e68a2c5efb3f2810550, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:48.767741 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084205-a824-4d1b-9780-aeaa1366fa12 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:48.778483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 153/310] 10.222.0.58 () {58 vars in 1334 bytes} [Wed May 11 16:49:48 2022] PUT /identity/v3/system/users/fd16f7cf0f224e68a2c5efb3f2810550/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 16:49:49.305050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208b6d-7b90-4131-8e40-67089e65b9e6 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:49.305440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208b6d-7b90-4131-8e40-67089e65b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:49.306164 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208b6d-7b90-4131-8e40-67089e65b9e6 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:49.307824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 158/311] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:49.312975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:49.313259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:49.313537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:49.330770 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:49.331974 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:49.401497 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 154/312] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:49.424879 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208b6d-7b90-4131-8e40-67089e65b9e6 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:49.529943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208b6d-7b90-4131-8e40-67089e65b9e6 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:49.563773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:49.565380 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:49.565838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:49.566299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:49.578390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:49.587554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:49.588409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:49.589185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:49.591188 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 159/313] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:49.597119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:49.699109 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97a94-fbde-4a0b-9b7e-cf0cb1760cb7 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:49.734976 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:49.735990 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:49.736443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:49.736871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:49.737738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:49.738178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:49.739808 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:49.748233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 155/314] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:49.753602 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:49.855242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123831dd-e4a1-407b-9d81-28bfc752892f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:49.887814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:49.888718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:49.889006 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:49.889282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] PATH_INFO: `/v3/users/df2770e6d9604202b8cf198bda3822d1` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:49.890449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=df2770e6d9604202b8cf198bda3822d1)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:49.892000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:49.893890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 160/315] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:49 2022] GET /identity/v3/users/df2770e6d9604202b8cf198bda3822d1 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:49.899812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:49.997507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba64e6-6170-45fc-950f-62b4497e4d79 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:50.030338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:50.030993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.031281 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.031746 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.097128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:50.098585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:50.201100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 156/316] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:50.206600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:50.308463 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a0d1-e518-4d3c-b85c-97ef5a35d3f9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:50.341909 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:50.342759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.343043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.343306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.344518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:50.346123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059bf7-2c79-470d-9498-03f38f47ec7b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:50.348136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 161/317] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:50 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:50.353870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:50.452492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18035-0958-4905-bc3b-af71fe42cb12 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:50.488574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:50.489238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.489523 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.489800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.490628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98, user.id=df2770e6d9604202b8cf198bda3822d1) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:50.490940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:50.492426 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283404a9-8944-444d-97c2-4ed2ffa7fda1 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:50.498704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 157/318] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:49:50 2022] GET /identity/v3/role_assignments?user.id=df2770e6d9604202b8cf198bda3822d1&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:50.841428 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600af5f-aeea-413e-8a11-559eadce781e None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.841931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600af5f-aeea-413e-8a11-559eadce781e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.841931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600af5f-aeea-413e-8a11-559eadce781e None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.843250 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 162/319] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:50.848516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.848906 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.849099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.855907 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839755-0372-494e-95cd-8a23584db03d None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.856190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839755-0372-494e-95cd-8a23584db03d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.856460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839755-0372-494e-95cd-8a23584db03d None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.857770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 163/320] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:50.862811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:50.863162 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:50.863530 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:50.865462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:50.866650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:50.881189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:50.882338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:50.932780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 158/321] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:50.951636 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 164/322] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:50.962730 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:50.982688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.060775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6167a3-dbcf-4951-9d2d-735266ee5738 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.083826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d134-6d99-412e-8a51-8d7cf897d7b0 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.093202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.093940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.094215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.094487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.104006 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:51.111608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:51.112508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:51.114063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 159/323] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:51.117588 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.118518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.118799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.118963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.119070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.120242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.121829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.123665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 165/324] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:51.129143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.219709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0821b-ab40-4b64-b579-62495edd18cc None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.221937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd0cc-d849-47a3-a73e-9aca98377e11 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.250631 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.251282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.251597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.251867 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.252594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:51.252895 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.253378 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.254035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.254276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed7a4-4637-4ad1-8f85-0d359ec62a11 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.254362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.254577 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] PATH_INFO: `/v3/groups` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.255258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.256729 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1777b-0d83-47fd-8a61-555d2420aab5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.262434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 160/325] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:51.265022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41fe95-89d4-4daa-b3a6-d61dc566649b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.265378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41fe95-89d4-4daa-b3a6-d61dc566649b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.265652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41fe95-89d4-4daa-b3a6-d61dc566649b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.267207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 161/326] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:51.271852 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41fe95-89d4-4daa-b3a6-d61dc566649b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.272628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 166/327] 10.222.0.58 () {60 vars in 1134 bytes} [Wed May 11 16:49:51 2022] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:49:51.273913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.274203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.274482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.292199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:51.293451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:51.364778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 167/328] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:51.389935 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.397084 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41fe95-89d4-4daa-b3a6-d61dc566649b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.432390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.433278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.433557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.433830 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] PATH_INFO: `/v3/users/37e178aa39414dc499a467ba617d45fa` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.435070 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] RBAC: Authorizing `identity:get_user(user_id=37e178aa39414dc499a467ba617d45fa)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.436590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.438274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 162/329] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/users/37e178aa39414dc499a467ba617d45fa => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:51.443921 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.509290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5f8e8-be17-4203-b4ed-e493283a1fbd None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.548843 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.549735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.550162 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.550412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.562348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4077-f326-4780-afa2-fcfce55c063a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.565908 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:51.574697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:51.575840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:51.576913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 168/330] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:51.583069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.604802 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.606012 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.606454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.606866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] PATH_INFO: `/v3/system/users/37e178aa39414dc499a467ba617d45fa/roles/58a46c744cc74545bea7641b37e0dd0c` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.608577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37e178aa39414dc499a467ba617d45fa, role_id=58a46c744cc74545bea7641b37e0dd0c)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.610140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.622999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 163/331] 10.222.0.58 () {58 vars in 1334 bytes} [Wed May 11 16:49:51 2022] PUT /identity/v3/system/users/37e178aa39414dc499a467ba617d45fa/roles/58a46c744cc74545bea7641b37e0dd0c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 16:49:51.695952 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626d59f-057c-45ec-b24e-854455c9a091 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.734891 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.735600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.735886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.736163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.736929 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:51.737234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.738687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.749269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 169/332] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:51.754601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:51.874941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbfb70-a9a2-4357-a6fe-46d8d47fa076 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:51.911634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:51.911634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:51.911634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:51.911634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] PATH_INFO: `/v3/users/fd16f7cf0f224e68a2c5efb3f2810550` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:51.912745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] RBAC: Authorizing `identity:get_user(user_id=fd16f7cf0f224e68a2c5efb3f2810550)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:51.914348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc869b0-0c1b-437d-a1bd-2d55023e52bc None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:51.917019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 164/333] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/users/fd16f7cf0f224e68a2c5efb3f2810550 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:51.927254 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:52.047581 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ee4f-b428-46d4-95f6-5a44a39e0c61 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:52.087286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:52.088229 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:52.088654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:52.089093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:52.090061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] RBAC: Adding query filter params (role.id=2b985b7fd08b44d0b2739997130a8251, user.id=fd16f7cf0f224e68a2c5efb3f2810550, scope.system=all) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:52.090513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:52.092123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826d9a8-7652-49c9-975d-bd5a71a5c3b1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:52.108371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 170/334] 10.222.0.58 () {56 vars in 1308 bytes} [Wed May 11 16:49:51 2022] GET /identity/v3/role_assignments?user.id=fd16f7cf0f224e68a2c5efb3f2810550&scope.system=all&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:54.202999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f273-8877-4ee4-b971-837042c728d6 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.204082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f273-8877-4ee4-b971-837042c728d6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.204618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f273-8877-4ee4-b971-837042c728d6 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.206944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 165/335] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:54.212612 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.213112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.213194 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.230522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:54.234516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:54.237479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b222b-270c-449a-8811-9a90fd4f5741 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.237769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b222b-270c-449a-8811-9a90fd4f5741 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.238048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b222b-270c-449a-8811-9a90fd4f5741 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.239439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 166/336] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:54.245090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.245650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.246135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.270967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:54.272517 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:54.330182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 171/337] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:54.368819 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.369593 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 167/338] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:54.412884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.493189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58c6d-389b-4973-8cb0-2f3aea537255 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:54.532691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:54.534518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.535890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.537363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.563612 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-dbf32802-26eb-4943-ba83-f406ea98269c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:54.581593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:54.582553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:54.583390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:54.587753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 172/339] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:54.610025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ef9a-4c04-4b05-998c-df22bd3f3136 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.610560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ef9a-4c04-4b05-998c-df22bd3f3136 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.611000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ef9a-4c04-4b05-998c-df22bd3f3136 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.612775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 173/340] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:54.613623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ef9a-4c04-4b05-998c-df22bd3f3136 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.617977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbaa8-75e6-43ae-bf10-ae487799ae95 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:54.654975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:54.655834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.656114 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.656388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.677815 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-4f9a8331-8f04-450c-9b98-bd07f331dfe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:54.685721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:54.686627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:54.687458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:54.692290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 168/341] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:54.703251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.703575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.703825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.725918 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:54.727020 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:54.812153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ef9a-4c04-4b05-998c-df22bd3f3136 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:54.823004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 169/342] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:54.823930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.856629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:54.857315 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.857599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.857874 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.858628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:54.858936 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:54.860358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:54.870039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 174/343] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:54.870938 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.929424 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1cdb3-0f15-4dfe-801b-b6103b3ff5ea None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:54.970562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:54.971292 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:54.971600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:54.971930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:54.972676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:54.972977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:54.974433 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:54.987694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 170/344] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:54.988487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:54.997016 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e50a7-c45c-439c-80bb-8a80cf4b5675 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.052808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.054069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.054557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.055035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.088299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:55.103385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:55.104386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 16:49:55.105180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:55.106363 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3b5b-6c75-4d55-a267-f70597fcc48d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.107922 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 175/345] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:55.108941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.146116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.147115 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.148274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.148937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.243090 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ced19-72d7-41f9-9f78-9d95aafec880 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.264531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.265998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.286658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.287333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.287643 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.287925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.360452 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.361954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415872b-00bc-452c-9fbb-7c88f895252a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.372153 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 171/346] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:55.372908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.466503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 176/347] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:55.467502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ba3-7131-4433-a4ee-5e1d42f0ba97 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.467794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ba3-7131-4433-a4ee-5e1d42f0ba97 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.468072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ba3-7131-4433-a4ee-5e1d42f0ba97 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.469489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 177/348] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:55.470031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8ba3-7131-4433-a4ee-5e1d42f0ba97 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.486054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f1929-5f8b-4ac7-834c-8536e4414bf9 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.528560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.529317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.529610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.530275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.531318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:55.531666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.533537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dff3ee-7c37-46a1-847a-48970d95bc7f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.544213 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 172/349] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:55.548191 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.548680 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.549142 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.570768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:55.573878 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:55.605355 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8ba3-7131-4433-a4ee-5e1d42f0ba97 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.647546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 173/350] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:55.647756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.648520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.648625 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.648816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.649128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.656172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.657618 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.659608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 178/351] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:55.660370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.756341 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15588e6-5f0c-49cf-a8e6-fda08ee5a4eb None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.772347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc76e9-e04c-4e08-92ae-f3f98c38bea8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.789836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.790624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.790904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.791178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.792404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.793861 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.795625 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 174/352] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:55.800232 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.809228 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.810225 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.810516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.810833 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] PATH_INFO: `/v3/users/37e178aa39414dc499a467ba617d45fa` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.812222 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] RBAC: Authorizing `identity:get_user(user_id=37e178aa39414dc499a467ba617d45fa)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.813816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.815882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 179/353] 10.222.0.58 () {56 vars in 1177 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/users/37e178aa39414dc499a467ba617d45fa => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:55.816788 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.906707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8988b3-ffab-4787-852e-e033e4ebd923 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.926341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f857a00-03d7-4eab-843d-762a2b6b6701 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:55.942478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.947231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.947231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.947231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.959609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:55.959609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:55.959609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 175/354] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:55.959609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:55.964949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:55.965804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:55.966087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:55.966458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:55.979045 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:55.987048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:55.989221 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 180/355] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:55.991123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.072580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f24c-bf64-4fe0-a090-65ca0288616d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.115706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf483c2-65ce-4ff7-b3be-cf81300b3d64 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.116027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.116868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.117330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.117615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.120347 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.121821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.123663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 176/356] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:56.124787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.160078 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.160746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.161020 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.161290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.162850 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] RBAC: Adding query filter params (role.id=58a46c744cc74545bea7641b37e0dd0c, user.id=37e178aa39414dc499a467ba617d45fa, scope.system=all) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:56.162850 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.163998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.176556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 181/357] 10.222.0.58 () {56 vars in 1308 bytes} [Wed May 11 16:49:55 2022] GET /identity/v3/role_assignments?user.id=37e178aa39414dc499a467ba617d45fa&scope.system=all&role.id=58a46c744cc74545bea7641b37e0dd0c => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:56.177224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.254241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a50c3-508d-4f58-b3eb-678d9c762699 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.293737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaf8c-bbe4-4817-a47e-6550eccdd276 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.298265 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.298930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.299216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.299550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.300387 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=24a91388961c479f81705073f3551c6f) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:56.300698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.302336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253d99e-a225-4b67-9241-e0f84e26797a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.308991 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 177/358] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:56.310357 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edf8a-fba4-4189-9c24-b5d55397355e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.310647 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edf8a-fba4-4189-9c24-b5d55397355e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.310927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edf8a-fba4-4189-9c24-b5d55397355e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.312416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 178/359] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:56.313047 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edf8a-fba4-4189-9c24-b5d55397355e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.349157 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.350004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.350281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.350552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.351384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:56.351695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.353831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b32194-a77c-417a-bd95-7024ff4b38e2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.371952 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 182/360] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:56.373285 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.373543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.373817 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.404494 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:56.405692 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:56.437720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edf8a-fba4-4189-9c24-b5d55397355e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.497107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.497778 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.498063 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.498434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.499272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=24a91388961c479f81705073f3551c6f) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:56.502127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.503180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.509717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 179/361] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:56.510666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.515479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 183/362] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:56.559271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.676663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e8a7-7541-4bbe-a42a-9d8ad1dad8c6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.705236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c871dc-cad3-40ea-a181-47c83116e473 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.736096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.737058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.737512 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.737944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.741669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.742486 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.742805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.743084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.767696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:56.781167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:56.782140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:56.782932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 184/363] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:49:56.790859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.850174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.851840 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a365-687c-4b57-8b95-f6f695fcfa13 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.927086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc2079-d1b8-4483-99e7-9ffe95720ede None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:56.962392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 180/364] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:56.964124 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34256ea-5611-49a1-8b7e-a26d47b568e6 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.964616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34256ea-5611-49a1-8b7e-a26d47b568e6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.965597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34256ea-5611-49a1-8b7e-a26d47b568e6 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.967425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 181/365] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:56.972235 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34256ea-5611-49a1-8b7e-a26d47b568e6 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:56.973995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:56.974673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.974958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.975281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:56.976266 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:56.976583 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:56.979222 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40296-9a6b-4f49-98d2-4496eefc661a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:56.989728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 185/366] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:56.996296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:56.997094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:56.998535 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.024798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:57.026832 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:57.099466 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34256ea-5611-49a1-8b7e-a26d47b568e6 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.113096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 186/367] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:57.113952 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.140574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.141502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.141797 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.142102 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.143338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.144941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.148669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 182/368] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:56 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:57.155062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.252025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fff8b-6f08-420b-af1e-2c993e56f827 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.279757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad913-f2d8-4e4f-a919-3b3646ae1197 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.288536 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.289286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.289654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.290726 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.327609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.328544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.328879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.329229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.343078 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:57.353197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:57.354120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:57.354899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 183/369] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:57.355700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.385859 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.388901 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.483303 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16213fa-6f82-496f-9d17-d5fe46504823 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.525954 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.526929 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.527251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.527649 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.529128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.530607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 187/370] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:57.531459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.531765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.533258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 184/371] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:57.538894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.652514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c999561-8e32-4498-a768-46f982380e2a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.660926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733bc7-9669-4787-a843-4e0a442ea8a5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.702042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.703818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.704727 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.705850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.707233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:57.707574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.709202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.709862 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.710141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.710415 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.711150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:57.711479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.712984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.713290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.720838 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 185/372] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:57.722225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.735058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 188/373] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:57.735058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:57.886244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb169a76-d476-4dcb-8b69-29f893720698 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:57.926116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:57.926993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:57.927278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:57.930022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:57.930715 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:57.932353 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:57.936785 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 186/374] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:57.944111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:58.001314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6d37-3855-4650-a8e9-a05cc2a74e2b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.072973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.073639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.073921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.074198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.074964 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe5bf-cb53-4775-825a-7ae4393646a2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.114855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.116126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.116615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.117118 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.119457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.128755 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.130901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 187/375] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:58.136750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:58.159915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.161368 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.262348 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 189/376] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:49:58.272018 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:58.346956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fe80-cc1a-4322-9772-900266e993cd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.382023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed5c5d-74d7-4f55-948d-2636caff1771 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.420064 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.420949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.421314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.421643 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] PATH_INFO: `/v3/projects/f17a7c59ed4e463892351b1b51c21b1b` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.422902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] RBAC: Authorizing `identity:get_project(project_id=f17a7c59ed4e463892351b1b51c21b1b)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.423698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.424513 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.424624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.425024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.425507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.426471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:58.426922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.428534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.434321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 190/377] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:49:58 2022] GET /identity/v3/projects/f17a7c59ed4e463892351b1b51c21b1b => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:58.434321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:58.445677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 188/378] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:49:58 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:49:58.541654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cfce-d20b-4152-94be-78b290081bdb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.582386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdb909-f56b-4596-9667-5266379039ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.583398 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdb909-f56b-4596-9667-5266379039ea None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.583753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdb909-f56b-4596-9667-5266379039ea None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.584095 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdb909-f56b-4596-9667-5266379039ea None admin] PATH_INFO: `/v3/groups/fc429751eb1d4b909563530792035c75` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.594532 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdb909-f56b-4596-9667-5266379039ea None admin] RBAC: Authorizing `identity:get_group(group_id=fc429751eb1d4b909563530792035c75)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.596166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdb909-f56b-4596-9667-5266379039ea None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.598396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 191/379] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:58 2022] GET /identity/v3/groups/fc429751eb1d4b909563530792035c75 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:58.604991 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:58.750968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239fde0-1eb3-4edf-a01f-0721c8e3ee7c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:58.796648 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:58.797311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:58.797603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:58.797879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:58.798714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] RBAC: Adding query filter params (group.id=fc429751eb1d4b909563530792035c75, role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=f17a7c59ed4e463892351b1b51c21b1b) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:58.799024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:58.800500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4cb12-49ae-463d-98af-db92b363300f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:58.811966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 189/380] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:49:58 2022] GET /identity/v3/role_assignments?group.id=fc429751eb1d4b909563530792035c75&scope.project.id=f17a7c59ed4e463892351b1b51c21b1b&role.id=df86ea59d76740488f867f6211ccfa28 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:59.218181 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a0a-8e22-4908-90ce-012cae8df58f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.218570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a0a-8e22-4908-90ce-012cae8df58f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.218746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a0a-8e22-4908-90ce-012cae8df58f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.220431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 192/381] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:49:59.226213 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f93b-c722-41aa-b0d5-955c0ae8d223 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.226507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f93b-c722-41aa-b0d5-955c0ae8d223 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.226793 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f93b-c722-41aa-b0d5-955c0ae8d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.246355 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8af4f93b-c722-41aa-b0d5-955c0ae8d223 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:59.247630 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8af4f93b-c722-41aa-b0d5-955c0ae8d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:59.334744 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 190/382] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:49:59.371116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7a0a-8e22-4908-90ce-012cae8df58f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:59.442334 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5b37-fc02-4bbf-b10c-b908fcc692ab None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.442832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5b37-fc02-4bbf-b10c-b908fcc692ab None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.442904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5b37-fc02-4bbf-b10c-b908fcc692ab None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.444400 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 191/383] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:49:59.449943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.450231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.450510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.487716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:49:59.488917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:49:59.498307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7a0a-8e22-4908-90ce-012cae8df58f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:59.567683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:59.568498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.568782 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.569060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.589874 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:59.598215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:59.599106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:49:59.599971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:49:59.600565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 193/384] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:49:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:59.615603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 192/385] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:49:59.615865 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:59.651381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:59.785572 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7426c8-99b4-4c76-a4ca-8bbce781f373 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:59.842958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f8f7-b9ab-4f2a-b86c-c2df6d76e944 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:49:59.844914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:59.845585 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.845870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.846145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.846899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:49:59.847204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:49:59.848616 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:49:59.866028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 194/386] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:49:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:49:59.870523 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:49:59.910259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:49:59.911570 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:49:59.912013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:49:59.912301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:49:59.926842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:49:59.938839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:49:59.939780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:49:59.940585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 193/387] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:49:59.947328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.052465 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471565e-207c-45b0-a963-da8e747e45a9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.105972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8283369-fe80-4781-94d5-0aa09726571b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.119923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.120796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.121080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.121358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.122594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.124069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.125696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 195/388] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:49:59 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:00.132100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.152896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.153524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.153853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.154137 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.154888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:00.155200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.156612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.172388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 194/389] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:00.177927 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.318024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7611-82cf-4f5f-899c-1d3d2602b976 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.334699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223682d7-eb82-4763-951b-7475fdca4056 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.377408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.378275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.378561 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.378839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.382556 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.384576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.391225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 195/390] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:00 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:00.396928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.405424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.406346 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.406629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.406905 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.408191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.409634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.418373 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 196/391] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:00 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:00.419218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.561957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f88a-c3db-4b97-9394-c01834c02b11 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.575048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd38a-5bc1-419f-9d47-cd7f8e518e82 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.618837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.619733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.620018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.620296 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.622241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.623717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.627944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 196/392] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:00 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:00.631500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:00.644694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.645528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.645809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.646084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/0dc581b2d2fc4530b12c23b1b965c984` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.656219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, group_id=8ea5ee48f7c74c26b5310b9c65039c34, role_id=0dc581b2d2fc4530b12c23b1b965c984)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.657588 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1810-2c64-424b-8c35-ea2be52a1359 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.694011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 197/393] 10.222.0.58 () {58 vars in 1442 bytes} [Wed May 11 16:50:00 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/0dc581b2d2fc4530b12c23b1b965c984 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:00.746360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39477f4-d1d1-4452-945d-6042d1760158 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:00.782648 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:00.783982 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:00.784481 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:00.784965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:00.787547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] RBAC: Authorizing `identity:create_grant(project_id=24a91388961c479f81705073f3551c6f, group_id=8ea5ee48f7c74c26b5310b9c65039c34, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:00.789330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a95d80-60f4-46a2-ad98-2989fe5bfc9b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:00.815992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 197/394] 10.222.0.58 () {58 vars in 1442 bytes} [Wed May 11 16:50:00 2022] PUT /identity/v3/projects/24a91388961c479f81705073f3551c6f/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:01.005920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57629-4af0-43cf-be6b-59df91ee37bd None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.006313 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57629-4af0-43cf-be6b-59df91ee37bd None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.006503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57629-4af0-43cf-be6b-59df91ee37bd None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.007896 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 198/395] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:01.015093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.015729 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.016215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.037635 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:01.038844 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:01.122941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 198/396] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:01.147147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa57629-4af0-43cf-be6b-59df91ee37bd None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.272892 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa57629-4af0-43cf-be6b-59df91ee37bd None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:01.316191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:01.317220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.317644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.318079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.336332 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:01.344471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:01.345515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:01.346492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:01.348718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 199/397] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:01.355269 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.496378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d102b6-76f5-4406-b7b2-d153e38bd492 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:01.532207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:01.532798 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.533077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.533352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.534088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:01.534389 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:01.535809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c4585-93f1-481f-b91a-78ec64bcb73b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:01.545176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 199/398] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:01.550793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.597858 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04becf3-6a6e-4a5b-9c65-40f03fb7998e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.598378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04becf3-6a6e-4a5b-9c65-40f03fb7998e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.598624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04becf3-6a6e-4a5b-9c65-40f03fb7998e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.600390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 200/399] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:01.606379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.606665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.607048 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.636384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:01.637766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:01.680456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa30ea-69e6-4eb0-8028-0229aec9c100 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:01.714761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 201/400] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:01.717909 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:01.719022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.719530 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.720007 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.721409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:01.723059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:01.725201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 200/401] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:01.731390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.757669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.837667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754b00-7242-4065-8205-f76f413ff9d0 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:01.877561 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:01.878424 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.878700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.878971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.880952 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:01.882723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:01.887439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 202/402] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:01.896370 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:01.904520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a3464-1260-420a-87ab-6f77bce5c71e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:01.942619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:01.943825 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:01.944335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:01.944810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:01.956158 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:01.965960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:01.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:01.968072 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:01.970463 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 201/403] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:01.979799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.061759 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4cc70-9e15-4284-ab5e-664c31eb843d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.099601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1dea3-93f7-4cdf-ac42-3b0eaf7a1b13 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.101613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.103261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.103768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.104255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.106416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, group_id=8ea5ee48f7c74c26b5310b9c65039c34, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.108251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db336f6-c2ec-4087-b59d-da5182bf6188 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.132467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 203/404] 10.222.0.58 () {58 vars in 1442 bytes} [Wed May 11 16:50:01 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:02.134304 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26892-4659-422d-b40f-727b3ad4a13e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.134489 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26892-4659-422d-b40f-727b3ad4a13e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.134744 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26892-4659-422d-b40f-727b3ad4a13e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.136629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 204/405] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:02.145706 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.146011 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.146272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.167552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.168230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.168516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.168797 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.169572 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:02.169882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.171325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.183977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:02.185244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:02.196589 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 202/406] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:02.197550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.325369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 205/407] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:02.350946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ab90-3500-4cb9-acf2-a6753e487f6c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.360552 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.392764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.393632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.393910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.394243 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.395573 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.398347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.403842 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 203/408] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:02 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:02.408917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.490733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a853-bf3a-4839-b7cf-36175740410a None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.525265 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.526085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.526337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.526610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.544780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:02.555374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471faa-525a-446f-a20f-08f576818d32 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:02.555547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:02.556397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:02.557183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 206/409] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:02.564367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.589781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.590646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.590929 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.591210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.594731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.596206 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.604639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 204/410] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:02 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:02.607883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.730287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5697086-36fa-4457-960a-3facfd4db9d8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.760550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262aa3f-7a30-4263-ae2c-785f4b2ebaec None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.767425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.767425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.767425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.767425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/0dc581b2d2fc4530b12c23b1b965c984` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.773968 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fc4575ba43eaa6ae7d3552528b98, group_id=8ea5ee48f7c74c26b5310b9c65039c34, role_id=0dc581b2d2fc4530b12c23b1b965c984)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.775649 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.796809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 205/411] 10.222.0.58 () {58 vars in 1442 bytes} [Wed May 11 16:50:02 2022] PUT /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98/groups/8ea5ee48f7c74c26b5310b9c65039c34/roles/0dc581b2d2fc4530b12c23b1b965c984 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:02.822819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.823877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.824306 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.824759 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.825727 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:02.826191 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.827940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:02.837942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 207/412] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:02.843571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:02.952350 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e6fb-7c41-4849-86bb-7128dd9f663a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:02.992279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:02.994207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:02.994639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:02.995059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] PATH_INFO: `/v3/groups/fc429751eb1d4b909563530792035c75` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:02.996707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] RBAC: Authorizing `identity:get_group(group_id=fc429751eb1d4b909563530792035c75)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:02.998322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:03.000719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 206/413] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:02 2022] GET /identity/v3/groups/fc429751eb1d4b909563530792035c75 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:03.007164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:03.152079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca3d3-5340-41c9-8566-6df1f30b6e71 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:03.186574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:03.187457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:03.187740 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:03.188012 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] PATH_INFO: `/v3/projects/f17a7c59ed4e463892351b1b51c21b1b` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:03.189173 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] RBAC: Authorizing `identity:get_project(project_id=f17a7c59ed4e463892351b1b51c21b1b)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:03.190611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef1c80-1d8f-4155-a68f-dc089164fedf None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:03.192315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 208/414] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:03 2022] GET /identity/v3/projects/f17a7c59ed4e463892351b1b51c21b1b => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:03.198431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:03.343793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479ad2-2f0f-4918-a8b8-08611e6f2643 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:03.376928 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:03.377807 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:03.378087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:03.378357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] PATH_INFO: `/v3/projects/f17a7c59ed4e463892351b1b51c21b1b/groups/fc429751eb1d4b909563530792035c75/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:03.380364 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] RBAC: Authorizing `identity:create_grant(project_id=f17a7c59ed4e463892351b1b51c21b1b, group_id=fc429751eb1d4b909563530792035c75, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:03.381804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464f63-84db-40d9-ad8b-4af30bb13438 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:03.403948 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 207/415] 10.222.0.58 () {58 vars in 1442 bytes} [Wed May 11 16:50:03 2022] PUT /identity/v3/projects/f17a7c59ed4e463892351b1b51c21b1b/groups/fc429751eb1d4b909563530792035c75/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:03.651958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c809e0-b2bc-4fa5-a0c7-a2f4024d3fad None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:03.652587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c809e0-b2bc-4fa5-a0c7-a2f4024d3fad None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:03.653073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c809e0-b2bc-4fa5-a0c7-a2f4024d3fad None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:03.655027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 209/416] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:03.661169 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4300-c1da-4beb-89cf-1810b3d01191 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:03.661461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4300-c1da-4beb-89cf-1810b3d01191 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:03.661737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4300-c1da-4beb-89cf-1810b3d01191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:03.686288 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4cdc4300-c1da-4beb-89cf-1810b3d01191 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:03.687513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4cdc4300-c1da-4beb-89cf-1810b3d01191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:03.769771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 208/417] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:03.802050 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c809e0-b2bc-4fa5-a0c7-a2f4024d3fad None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:03.952041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c809e0-b2bc-4fa5-a0c7-a2f4024d3fad None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.000595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.001405 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.001687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.001961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.016752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-4bfbf004-d4a9-40b1-912a-d7179ec63c59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:04.025459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:04.026366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:04.028151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:04.029607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a246-fc6a-4366-bd3a-a39252751a13 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.029607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a246-fc6a-4366-bd3a-a39252751a13 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.029607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a246-fc6a-4366-bd3a-a39252751a13 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.031176 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 209/418] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:04.031386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 210/419] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:04.035500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a246-fc6a-4366-bd3a-a39252751a13 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.036049 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.036339 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.036619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.062877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:04.064463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:04.170733 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a246-fc6a-4366-bd3a-a39252751a13 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.172746 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 211/420] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:04.199146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.220969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.221949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.222447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.222910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.223916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:04.224410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:04.226002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:04.246314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 210/421] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:04.251393 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.317880 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ecca-c09d-4620-9fb9-d9104f960fc3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.366475 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.367282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.368144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.368432 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.387157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:04.401500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:04.402480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:04.403244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:04.404401 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 212/422] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:04.408942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.411300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150f64-a3bf-4c9b-8206-87e3ad9691c8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.455770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.456425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.456708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.456987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.573870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5038-f66f-4b63-b0a0-95979b3de732 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.614899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:04.616391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:04.617072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.617793 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.618077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.618353 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.619100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] RBAC: Adding query filter params (name=member) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:04.619434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:04.620799 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:04.639659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 213/423] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:04.645082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.733885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 211/424] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:04.738904 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.816288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b19b-5242-4f51-acd5-95a53ff0a286 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.854031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.855310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.855840 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.856304 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.925386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d2da-e087-4497-8f7b-b1d2a73d1fee None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:04.960396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:04.962181 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:04.962656 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:04.963118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:04.964528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:04.966143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:04.968371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 212/425] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:04.973778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:04.982773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:04.984268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9eda-44f1-419a-8d5c-bcd32abe60a9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.075155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7eb12-6142-47f8-8318-fe067db594fe None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.109853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.111048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.111574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.112043 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.113435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.115088 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.117248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 213/426] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:05.123178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.210932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 214/427] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 16:50:05.213118 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823354cc-d48c-4ff5-8235-2ed7c7940dee None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.213118 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823354cc-d48c-4ff5-8235-2ed7c7940dee None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.213421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823354cc-d48c-4ff5-8235-2ed7c7940dee None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.218746 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 215/428] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:05.219647 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823354cc-d48c-4ff5-8235-2ed7c7940dee None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.247032 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee21273-a844-4714-9a4f-2920bcdd4dd1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.288604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.290500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.290933 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.291370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.292330 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=24a91388961c479f81705073f3551c6f) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:05.292797 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.294363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7f86-7b51-4eb5-a507-d6f7b90b99fb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.302953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 214/429] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:05.304606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.305848 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.306297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.325123 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823354cc-d48c-4ff5-8235-2ed7c7940dee None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.327401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:05.329803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:05.363011 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.364413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.364764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.365126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] PATH_INFO: `/v3/projects/24a91388961c479f81705073f3551c6f` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.366633 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] RBAC: Authorizing `identity:get_project(project_id=24a91388961c479f81705073f3551c6f)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.368837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.372666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 216/430] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/projects/24a91388961c479f81705073f3551c6f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:05.381209 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.494671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 215/431] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:05.497761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058463c4-dc1a-4f38-a51b-b1d5cb59015b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.525861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.538759 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.539709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.539997 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.540274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.543205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.544766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.546775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 217/432] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:05.552598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.665667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac29f-cc5f-4f61-8ba5-7710552eea99 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.673747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f402a-44cf-4c10-9a5f-0f9ecb33f57e None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.700935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.701592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.701873 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.702148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.702967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=24a91388961c479f81705073f3551c6f) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:05.703276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.704741 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82b94a-8580-4bd3-b40c-381c2a42d3ff None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.710791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 218/433] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=24a91388961c479f81705073f3551c6f&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:05.712342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bac2-bb2b-47c3-bba7-e1576c61be40 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.712837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bac2-bb2b-47c3-bba7-e1576c61be40 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.713193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bac2-bb2b-47c3-bba7-e1576c61be40 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.714729 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 219/434] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:05.720304 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.720487 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.720610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.720853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.721861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.722365 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.722835 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.735429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:05.738469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:05.739744 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:05.746264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:05.747232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 16:50:05.748107 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:05.751313 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 216/435] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:05.757376 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.824819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 220/436] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:05.850646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.891820 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540e75-3ab4-4c0e-a258-9aa48267695f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:05.929604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:05.931030 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:05.932522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:05.933038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:05.933794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:05.934106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:05.935555 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:05.948320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 217/437] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:05.950751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:05.987481 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605769-4e28-46e1-9e9a-7279d595ea72 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.039970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.040846 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.041155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.041429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.058429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:06.066621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:06.067595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 16:50:06.068391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:06.069775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 221/438] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:06.075045 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.086999 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2d86-3af4-4fbd-bdb3-e02dcf9290e1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.135175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.135876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.136155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.136436 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.205820 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13067e9-4a0e-45c8-9bb6-ec3800abb940 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.219475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.221201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c47a-1db4-4cd1-a738-9bc871ad9ef8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.256555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.257240 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.257526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.257802 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.259388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:06.261659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.263065 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.275453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 222/439] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:06.280975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.345691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 218/440] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 16:50:06.346875 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ab4c-b64a-46f9-bfcd-114eaead13f0 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.347161 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ab4c-b64a-46f9-bfcd-114eaead13f0 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.348134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ab4c-b64a-46f9-bfcd-114eaead13f0 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.348838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 219/441] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:06.351616 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766ab4c-b64a-46f9-bfcd-114eaead13f0 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.405821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc26c6-444d-4834-89c7-7ceeed32ce88 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.437573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.438219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.438498 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.438775 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.458752 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766ab4c-b64a-46f9-bfcd-114eaead13f0 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.493722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.494774 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.495052 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.495322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.496516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.498130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631acd-20ab-408b-b84a-4630c68c33ab None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.500028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 220/442] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:06.501164 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.501447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.501719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.508643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.510106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.522852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:06.524641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:06.604232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 221/443] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:06.604232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.604507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 223/444] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:06.609786 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.696823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13eb66-a11a-4c44-a219-43b8653e7bdb None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.700464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01856-4d77-4204-af16-7cba0a963567 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.728637 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.729480 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.729760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.730031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.731177 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.732468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.732633 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.733308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.733592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.733868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] PATH_INFO: `/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.734212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 222/445] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:06.734949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.735064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] RBAC: Authorizing `identity:get_project(project_id=7d72fc4575ba43eaa6ae7d3552528b98)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.736487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.738308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 224/446] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/projects/7d72fc4575ba43eaa6ae7d3552528b98 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:06.743913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.825683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b013c6-776d-44ff-944d-6c74bddc53b3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.835148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd62c-49e2-410b-bbb9-7320f6b6f731 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.858237 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.858947 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.859225 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.859526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.868008 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.868876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:06.869157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:06.869434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] PATH_INFO: `/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:06.869776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:06.870658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea5ee48f7c74c26b5310b9c65039c34)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:06.872153 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:06.873780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 225/447] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/groups/8ea5ee48f7c74c26b5310b9c65039c34 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:06.874542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:06.878195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:06.879104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:06.880000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 223/448] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:06.880661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:06.967041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5dad-9e94-40ad-8dea-5e205567b485 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.975314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde33f-57f9-4aa6-b8ad-7e96cb282346 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:06.999134 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:06.999821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.000111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.000390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.001204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=2b985b7fd08b44d0b2739997130a8251, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:07.001516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.002955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.006282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.006951 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.007235 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.007544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.008362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] RBAC: Adding query filter params (group.id=8ea5ee48f7c74c26b5310b9c65039c34, role.id=0dc581b2d2fc4530b12c23b1b965c984, scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:07.008676 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.008808 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 226/449] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=2b985b7fd08b44d0b2739997130a8251 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:07.009469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:07.010098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.027642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 224/450] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:50:06 2022] GET /identity/v3/role_assignments?group.id=8ea5ee48f7c74c26b5310b9c65039c34&scope.project.id=7d72fc4575ba43eaa6ae7d3552528b98&role.id=0dc581b2d2fc4530b12c23b1b965c984 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:07.121177 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991422a-f0ed-485f-9719-e7e0caa14723 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:07.157530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.158225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.158507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.158783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.159598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:07.159907 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.161376 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.170999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 227/451] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:07.176866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:07.281882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddcdf-d829-4bbc-8180-b913e88b79ab None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:07.313981 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.314730 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.315044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.315319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.381846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.383764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.484152 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 225/452] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:07.489717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:07.584712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1effc-7790-4d9c-a90e-50da917bfe5d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:07.616031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.616879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.617164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.617461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] PATH_INFO: `/v3/projects/f17a7c59ed4e463892351b1b51c21b1b` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.618613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] RBAC: Authorizing `identity:get_project(project_id=f17a7c59ed4e463892351b1b51c21b1b)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.620073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.621728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 228/453] 10.222.0.58 () {56 vars in 1186 bytes} [Wed May 11 16:50:07 2022] GET /identity/v3/projects/f17a7c59ed4e463892351b1b51c21b1b => generated 344 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:07.627236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:07.718299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6eff-4f4e-4b49-a819-da46ab5c3030 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:07.748998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.749826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.750109 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.750383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] PATH_INFO: `/v3/groups/fc429751eb1d4b909563530792035c75` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.751544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] RBAC: Authorizing `identity:get_group(group_id=fc429751eb1d4b909563530792035c75)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.752960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee0b5-24ce-4d97-9130-115e5daa19c1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.754514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 226/454] 10.222.0.58 () {56 vars in 1180 bytes} [Wed May 11 16:50:07 2022] GET /identity/v3/groups/fc429751eb1d4b909563530792035c75 => generated 229 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:07.760031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:07.851619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87de44b-07d5-479e-95ba-1a53e71a6c9a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:07.882262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:07.882896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:07.883711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:07.883985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:07.884797 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] RBAC: Adding query filter params (group.id=fc429751eb1d4b909563530792035c75, role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=f17a7c59ed4e463892351b1b51c21b1b) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:07.885105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:07.886519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4251b8-84f3-4ef6-b051-b329b9215f6b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:07.892239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 229/455] 10.222.0.58 () {56 vars in 1376 bytes} [Wed May 11 16:50:07 2022] GET /identity/v3/role_assignments?group.id=fc429751eb1d4b909563530792035c75&scope.project.id=f17a7c59ed4e463892351b1b51c21b1b&role.id=df86ea59d76740488f867f6211ccfa28 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:10.456900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a01bd-fbde-435e-a074-bc9ec0f6f533 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.457953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a01bd-fbde-435e-a074-bc9ec0f6f533 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.458430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a01bd-fbde-435e-a074-bc9ec0f6f533 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.466516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 227/456] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:10.477394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935513-9f7d-4316-96f2-df301114e4da None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.478168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935513-9f7d-4316-96f2-df301114e4da None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.478653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935513-9f7d-4316-96f2-df301114e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.495937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-2e935513-9f7d-4316-96f2-df301114e4da None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:10.497379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-2e935513-9f7d-4316-96f2-df301114e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:10.575466 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 230/457] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:10.596411 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a01bd-fbde-435e-a074-bc9ec0f6f533 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:10.618154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d15d57-fd71-49ef-808b-46f041a459a5 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.618458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d15d57-fd71-49ef-808b-46f041a459a5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.618738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d15d57-fd71-49ef-808b-46f041a459a5 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.620547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 231/458] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:10.625446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.625726 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.625999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.642866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:10.644080 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:10.710361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 232/459] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:10.715761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a01bd-fbde-435e-a074-bc9ec0f6f533 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:10.736646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:10.751603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:10.752601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.752886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.753161 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.763012 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:10.764595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-296d2359-7141-4b18-81d9-0e6d5e2afa0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:10.782256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:10.783148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 228/460] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d42ce5-6351-49b7-8fca-f294bcd2db2c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d42ce5-6351-49b7-8fca-f294bcd2db2c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d42ce5-6351-49b7-8fca-f294bcd2db2c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.788274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 229/461] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:10.792443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.792728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.793008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.809105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:10.810281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:10.837814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d81744-08de-4d4e-b54a-8bc06baf1348 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:10.871238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:10.872079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:10.872360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:10.872640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:10.883501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 230/462] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:10.883501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:10.889385 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:10.890883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:10.910882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:10.911823 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 233/463] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:10.917677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:10.980111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a054fe-2229-4887-875b-f98c474fa31b None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.011091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1275b-73f9-422d-b258-0f99b908820f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.012049 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.012701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.012982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.013261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.013972 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:11.014275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.015669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.031376 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 231/464] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:11.031376 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.048698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.049474 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.049756 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.050024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.059711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.061155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:11.078657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:11.079598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:11.080765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:11.080765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:11.080765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:11.080765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:11.080765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 234/465] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:11.081041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.126676 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca7ee-96e9-4958-9085-623bd6728900 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.159578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.160226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.160504 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.160772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.161484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:11.161781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.163147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d580-76d2-405c-8260-504ca63bd9c2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.172415 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514083-cb3b-4acd-b58e-82eff9ec0903 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.174337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 232/466] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:11.175684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5dcd-da7c-4b93-a258-14eb2b17f715 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.175972 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5dcd-da7c-4b93-a258-14eb2b17f715 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.176245 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d5dcd-da7c-4b93-a258-14eb2b17f715 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.179499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 233/467] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:11.179499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d5dcd-da7c-4b93-a258-14eb2b17f715 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.205391 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.206047 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.206331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.206606 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.207297 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.208804 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.226959 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 235/468] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:50:11 2022] POST /identity/v3/users => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:11.227796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.280364 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d5dcd-da7c-4b93-a258-14eb2b17f715 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.316910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.317580 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.317863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.318140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.318870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:11.319172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.321155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbbf55-4f3d-43ba-85e4-3838e648ca60 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.333475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 234/469] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:11.334811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.335094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.335394 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.352555 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:11.353794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:11.355270 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f61c-2081-4d00-bbc2-9cf646d315b7 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.390562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.391560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.391989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.392420 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.393128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.394640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.419468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 236/470] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:50:11 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:11.419468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.434587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 235/471] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:11.462297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.543201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a5b3b-0907-4831-991e-4deea5d7bb83 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.575093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ffb2-de09-4ae6-9e40-f7491a8b58e4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.581577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.582557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.583083 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.583567 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.584482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.586276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.614848 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 237/472] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:50:11 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:11.616012 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.616954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.617830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.618305 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.630335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.631853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:11.651662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:11.652550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:11.653413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:11.653413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:11.653413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:11.653413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:11.653413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 236/473] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:11.658915 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.769162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200565b7-a0bf-4949-a045-11b64ce12a34 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.804622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.806191 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.806684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.807149 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.808100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:11.808598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.810174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861a25-b7b0-4b7c-9ea3-da9cfb0e730b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:11.829358 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 238/474] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:11.834967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:11.948721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6816-f528-4bf1-87b7-817cedf37760 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:11.982869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:11.983561 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:11.983847 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:11.984121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:11.984815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:11.986251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf36ac9-591f-4891-808f-431dd0ba4e0b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:12.007277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 237/475] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:50:11 2022] POST /identity/v3/users => generated 249 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:13.690074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1631-ac9f-4a96-88b5-527b65444575 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:13.690629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1631-ac9f-4a96-88b5-527b65444575 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:13.690629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1631-ac9f-4a96-88b5-527b65444575 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:13.692236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 239/476] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:13.698350 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4772c7-bb09-4ef5-af6b-329e956d8e2c None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:13.698772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4772c7-bb09-4ef5-af6b-329e956d8e2c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:13.698944 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4772c7-bb09-4ef5-af6b-329e956d8e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:13.715979 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2f4772c7-bb09-4ef5-af6b-329e956d8e2c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:13.717140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2f4772c7-bb09-4ef5-af6b-329e956d8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:13.784700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 238/477] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:13.809143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a1631-ac9f-4a96-88b5-527b65444575 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:13.844606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29fab-e968-419a-823b-1fae3c4b560c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:13.844926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29fab-e968-419a-823b-1fae3c4b560c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:13.845180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29fab-e968-419a-823b-1fae3c4b560c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:13.847973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 239/478] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:13.860388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:13.860675 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:13.860956 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:13.877232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:13.878408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:13.929848 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a1631-ac9f-4a96-88b5-527b65444575 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:13.958590 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 240/479] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:13.974708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:13.975762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:13.976210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:13.976674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:13.982425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:13.988577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:13.999099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:14.001226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:14.003841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 240/480] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:14.010111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.085794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74851-ac6e-4a17-b685-7aae4fb8fe7b None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.111156 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8707-c077-4acb-9e26-bd6874ad1124 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.120655 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.121443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.121721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.121994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.135688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-6161206d-9166-4e41-a184-46c9bb50a64c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:14.145256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.146258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:14.147039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 241/481] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:14.149463 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a391-2d67-4e4d-934f-d165926837ff None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.149810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a391-2d67-4e4d-934f-d165926837ff None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.150101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316a391-2d67-4e4d-934f-d165926837ff None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.151552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 242/482] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:14.156259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316a391-2d67-4e4d-934f-d165926837ff None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.160650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.161320 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.161604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.161882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.162632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:14.162937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.164379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c020d-541c-4f6f-b855-2379f61a1bb7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.176661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 241/483] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:14.176661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.176661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.176661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.189592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:14.190814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:14.260998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 242/484] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:14.268425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.270813 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316a391-2d67-4e4d-934f-d165926837ff None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.306168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.307153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.307651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.308242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.309311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:14.309790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.311183 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.319743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 243/485] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:14.325423 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.372629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49685d-c67e-417e-9aa0-a4618a274aad None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.405614 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.406502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.406785 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.407061 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.416575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.418033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.424294 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb445bf-d3de-4300-a3b2-1f65ce784f83 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:14.435145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.436022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.437036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:14.437036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:14.437036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:14.437036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:14.437036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 243/486] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:14.437709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.461311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.462203 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.462553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.462836 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.474028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-e6a313bc-63ba-4e04-9b91-2fc08bbc4094 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:14.482318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.483342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:14.484191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 244/487] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:14.484841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5a0d-701f-4b0f-8702-f1cbca735360 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.485185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5a0d-701f-4b0f-8702-f1cbca735360 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.485274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5a0d-701f-4b0f-8702-f1cbca735360 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.486503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 245/488] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:14.487192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec5a0d-701f-4b0f-8702-f1cbca735360 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.541069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f62572-40b4-4f97-b298-0fae7dbba738 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.573064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.573838 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.574140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.574414 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.582596 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec5a0d-701f-4b0f-8702-f1cbca735360 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.584054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.585505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:14.602407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.603290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.604178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:14.604178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:14.604178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:14.604178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:14.604178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 244/489] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:14.604445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.616782 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.617923 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.618199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.618465 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.619170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:14.619494 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.620835 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab508e-c54b-44bd-b3c3-370e1a0e795b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.631659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 246/490] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:14.632829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.633695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.633974 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.650246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:14.651425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:14.697871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02322-eeb4-4d84-85d3-f58d8afcca1c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.713342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 247/491] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:14.714157 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.729570 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.730234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.730520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.730796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.731572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:14.731881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.733258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.740970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 245/492] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:14.741756 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.808121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ae901-3031-4801-b22b-f86b5842248f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.834222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0bc1-cd3c-4b19-b759-f170bba5697c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.839075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.839751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.840034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.840308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.841023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:14.841324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.842677 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.853676 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 248/493] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:14.854445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.870488 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.871272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.871598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.871879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.879088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:14.880574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:14.895323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:14.896244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:14.897112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 246/494] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:14.898317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:14.950949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c71-a02e-4271-8f4b-6a774f35a9d9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.982443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:14.983217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:14.983530 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:14.983804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:14.990480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9809-212e-4778-ba6e-845eab6c5b84 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:14.993940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:15.001654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:15.002693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 249/495] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:15.003707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.024766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.025568 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.025849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.026122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.036015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.037462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:15.054184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:15.054998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:15.055871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:15.055871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:15.055871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:15.055871 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:15.056286 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 247/496] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:15.057096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.097607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af49aa-fab7-4b75-95fb-e6177d73720a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.128786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.129593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.129880 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.130153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.137288 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.138722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.149247 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216dc3-716f-4059-9f67-4a7ac72c8ed8 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:15.154223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:15.155189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 250/497] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:15.156246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.182625 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.183280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.183590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.183866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.184718 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:15.185022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.186440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.222018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 248/498] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:15.222860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.254992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48676a5-a6ba-4746-bda1-c0623a41aef6 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.286077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.286827 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.287170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.287613 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.288354 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:15.288656 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.290661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.298299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 251/499] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:15.299090 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.319109 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630c2c5-02b3-42f7-b210-366612dce70a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.350777 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.351461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.352377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.352655 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.353366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:15.353669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.355035 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.365399 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 249/500] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:15.366165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.391981 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f1c0-6f3a-453e-bd28-143bc850424a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.423053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.423662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.423939 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.424211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.425029 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:15.425333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.426727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.457224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6638ed5-c2d6-4501-807f-791d869f8c6d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.462474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 252/501] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:15.463190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.490062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9747-b985-486d-ae79-af948604c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.490747 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9747-b985-486d-ae79-af948604c777 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.490987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9747-b985-486d-ae79-af948604c777 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.491261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9747-b985-486d-ae79-af948604c777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.553317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be9747-b985-486d-ae79-af948604c777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.554627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77c86b-3303-4c03-bbd6-312891c524e8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.554795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be9747-b985-486d-ae79-af948604c777 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.586825 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.587622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.587902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.588175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.597640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.599074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:15.615748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:15.616608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:15.617446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:15.617446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:15.617446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:15.617446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:15.620647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 253/502] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:15.620647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.645356 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 250/503] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:15.646216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9747-b985-486d-ae79-af948604c777 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.713642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c13e-16c5-40f8-b44d-9a7ea2ba7b15 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.736058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9747-b985-486d-ae79-af948604c777 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.745136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.745909 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.746192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.746468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.753724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.755154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.767864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.768487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.768770 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.769037 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:15.769293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:15.770163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:15.771071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 254/504] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:15.771704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.832164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.833612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.866273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f5b56-2f79-4bcc-85fb-28efe08a74f9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:15.899832 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:15.900470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:15.900748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:15.901017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:15.901718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:15.902017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:15.903393 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:15.913883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 255/505] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:15.914651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:15.924974 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 251/506] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:15.925808 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.011759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fb2d-62ad-46d7-880e-7084043b96d4 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.017321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28eb3b-73d6-44fa-9f94-64bd8f71fad5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.043056 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.043869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.044148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.044424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.049311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.049990 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.050273 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.050556 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.051397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:16.051705 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.053111 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.054387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.055869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.069096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 252/507] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:16.069870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:16.072402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.073430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.074278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:16.074278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:16.074278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.074278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:16.074729 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 256/508] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.075296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.162362 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b954028-ecc8-4c2f-a33f-114684d2cc55 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.168126 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd020de-c7c9-469c-bf1d-3e53e862e190 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.193250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.194034 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.194317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.194592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.198803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.199608 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.199887 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.200159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.201978 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.203467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.210311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.212320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:16.218441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.219396 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:16.220288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 253/509] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.220835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:16.229957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.230831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 257/510] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.231963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.314970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd8b4-0f7b-49aa-b74e-fe0ec39ea995 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.326773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6b43b-63f5-45a5-85b0-1b5f23e58eb7 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.347856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.348495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.348778 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.349054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.359061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.359738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.360023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.360296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.361008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:16.361312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.362678 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.373465 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 258/511] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:16.374067 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.412852 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.414810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.468205 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623454f7-1d48-406b-a228-3c691ba1f1b1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.503851 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.504499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.504776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.505046 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.505866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:16.506170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.506465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 254/512] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:16.510950 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.511027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.529073 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 259/513] 10.222.0.58 () {56 vars in 1139 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:16.529073 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.597963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7391a-494f-4d92-b4a2-554d4e958cf3 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.616843 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa803ea-8f75-43e7-a665-53292d6c1b6d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.629272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.629944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.630225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.630499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.631210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:16.631543 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.632948 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.643685 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 255/514] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:16.644690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.649261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.650044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.650325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.650601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.657300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.658745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:16.673306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.674118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 260/515] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.679628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.736477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bd07-34ab-4c43-98ad-d63b194a8367 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.766891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.767571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef56cd-a14f-45b6-8bf7-8d650fd0ef9b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.767988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.767988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.768226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.778620 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.780069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:16.796955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.797767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.798766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:16.798766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:16.798766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:16.798766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:16.798766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 256/516] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.799029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.801306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.801490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.801757 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.802066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.865124 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.866477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.891367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d8e7-8acb-4918-b9f1-3d60dccc7483 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:16.923419 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:16.924207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:16.924491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:16.924768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:16.931156 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:16.932652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:16.947491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:16.948505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:16.949422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 257/517] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:16.949884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:16.958496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 261/518] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:16.959532 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.041590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb348f-d921-43c2-8b33-4b7c0efa3873 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.049913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3d53-ad4c-4507-9fac-43fe40165471 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.073450 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.074275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.074553 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.074821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.075650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.075952 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.081650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.082286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.082565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.082837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.083567 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.083870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.085213 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.095027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 258/519] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.095932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.100595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 262/520] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.100595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.187009 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2f40-389f-4d9a-b237-429f9993066e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.190197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a2cf1-12b8-452d-8944-5e47b15980e5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.220688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.221344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.221628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.221901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.222675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.222902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.223007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.223723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.224008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.224279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.224441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.234284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.235337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 259/521] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.235760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.236157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:17.253148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:17.254223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:17.255178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:17.255178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:17.255178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:17.255178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:17.255178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 263/522] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:17.260003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.330760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ce67-e4af-4f0f-9987-d30306e91a2b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.352822 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dcc0e-a707-4334-8de4-45de6903d50e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.361532 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.362177 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.362457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.362733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.363575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=68d73b4a0e1646a19c1c70479a98a736) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.363886 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.365304 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.370918 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 260/523] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/role_assignments?user.id=68d73b4a0e1646a19c1c70479a98a736&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.371705 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.385802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.386614 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.386895 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.387166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.394697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.396237 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:17.411502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:17.412412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:17.413259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 264/524] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:17.413752 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.494701 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513cf83-cb6f-4116-8fd4-ae05ba2986b7 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.525582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a7c0b-ec4d-4b84-be96-ab818b7c204e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.530076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.530868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.531247 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.531656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.532639 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=29e72d051cbc4630a7e0e197a6df5369) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.533054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.534679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.547453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 261/525] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/role_assignments?user.id=29e72d051cbc4630a7e0e197a6df5369&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.547453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.566793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.567707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.567994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.568268 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.569028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.569320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.571318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.589108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 265/526] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.590325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.660013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a506-b437-4190-83b9-e8dab8e902e9 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.697030 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.697894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.698274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.698726 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.699150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77d99-09c0-4ac1-a329-3f4deb7ea460 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.699787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.700194 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.701837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.719462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 262/527] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.721560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.737793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.738743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.739122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.739534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.747531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.749935 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:17.768773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:17.770083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:17.770925 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 266/528] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:17.775323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:17.827392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c571230-abb0-4288-a949-790cebe3446d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.862184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.863204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.863713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.864186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.865202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=24d4c4c8b0c740eeb45cae6aca0cc01c) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.865750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.867986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.874329 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 263/529] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/role_assignments?user.id=24d4c4c8b0c740eeb45cae6aca0cc01c&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:17.875153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297571cb-8341-4e5d-ae6d-eeb476b00980 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:17.912822 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:17.913487 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:17.913769 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:17.914580 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:17.915500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:17.915809 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:17.917289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aa488-0754-40e8-b1b7-0b64fb1df578 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:17.940408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 267/530] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:17.946696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:18.054540 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d2c0-57de-440d-8086-45a83d70bcb8 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:18.089542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:18.090550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:18.091053 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:18.091609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:18.092701 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=5f1f023aee544e4fa1c31808f7b3ba4e) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:18.093282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:18.094922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b178a-a9d2-4823-87ea-c253c9541dab None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:18.101269 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 264/531] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:17 2022] GET /identity/v3/role_assignments?user.id=5f1f023aee544e4fa1c31808f7b3ba4e&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:19.737963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda03c7e-d150-4494-834a-f7dcc5d2c23c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:19.738455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda03c7e-d150-4494-834a-f7dcc5d2c23c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:19.738455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda03c7e-d150-4494-834a-f7dcc5d2c23c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:19.740099 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 268/532] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:19.745375 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e290-68a8-4f64-8b5b-d66cf3cf5722 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:19.745779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e290-68a8-4f64-8b5b-d66cf3cf5722 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:19.745948 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e290-68a8-4f64-8b5b-d66cf3cf5722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:19.762660 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-08b9e290-68a8-4f64-8b5b-d66cf3cf5722 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:19.763880 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-08b9e290-68a8-4f64-8b5b-d66cf3cf5722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:19.831673 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 265/533] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:19.856059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda03c7e-d150-4494-834a-f7dcc5d2c23c None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:19.879562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720ac8a-83b0-4416-bcac-460d0f71b5ec None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:19.879883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720ac8a-83b0-4416-bcac-460d0f71b5ec None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:19.880129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720ac8a-83b0-4416-bcac-460d0f71b5ec None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:19.881724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 266/534] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:19.888300 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:19.888863 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:19.889146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:19.909925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:19.911448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:19.959074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda03c7e-d150-4494-834a-f7dcc5d2c23c None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:19.995462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:19.995793 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 267/535] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:20.000239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.000525 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.000802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.012209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:20.020058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:20.020798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.022666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:20.024283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 269/536] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:20.032458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.125406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f471f-15e8-4333-af2a-fa40bb769487 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.132223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2155-46a4-4000-bbd8-265a17876c5b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.160455 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.161404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.161983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.162268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.166441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.167189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.167506 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.167784 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.168591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:20.168836 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.170196 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.173724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:20.182234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.184484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.186392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:20.187159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 270/537] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:20.187159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.187313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 268/538] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:20.196612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.295423 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf101ac-0951-4236-be73-291323f3beec None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.313516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93942-0390-459a-908b-09c352ce5dcb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.328556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.329336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.329620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.329889 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.340430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.341849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.352555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.353392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.353845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.354265 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.355148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:20.355624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.357135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d9b3e-f6e0-463c-96dc-e9c68504d25d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-db314e5e-db76-4c18-b39a-20bf4ed00152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:20.358366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.359372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 271/539] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7abf5b-77f6-4eb2-9994-b79d0e4d36ba None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7abf5b-77f6-4eb2-9994-b79d0e4d36ba None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7abf5b-77f6-4eb2-9994-b79d0e4d36ba None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.364672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 272/540] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:20.365147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7abf5b-77f6-4eb2-9994-b79d0e4d36ba None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.372353 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 269/541] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:20.373923 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.374812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.375260 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.396872 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:20.398648 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:20.464108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7abf5b-77f6-4eb2-9994-b79d0e4d36ba None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.465043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 270/542] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:20.465870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.500562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.501217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.501498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.501771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.502483 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:20.502787 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.504204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5ab4-bfc9-4c2e-94d4-041027af2d66 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.515496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 273/543] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:20.516700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202795-2468-4fc7-8fe9-c4a5558b3385 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.516988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202795-2468-4fc7-8fe9-c4a5558b3385 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.517277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202795-2468-4fc7-8fe9-c4a5558b3385 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.518754 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 274/544] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:20.519480 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202795-2468-4fc7-8fe9-c4a5558b3385 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.560915 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4e07-4748-4dfe-b549-d01b1f3ed177 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.592912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.593691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.593984 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.594261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.603760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.605207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.614355 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202795-2468-4fc7-8fe9-c4a5558b3385 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:20.622909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.623856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.624716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:20.624716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:20.624716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:20.624716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:20.624716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 271/545] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:20.624979 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.649671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.650456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.650737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.651014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.660559 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-e86e0fd5-34d7-483d-bdcb-a81b5ab44023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:20.668808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.669727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:20.670520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 275/546] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:20.671201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.671527 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.671742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.687988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:20.689167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:20.724860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597256-a3fc-4139-9e37-e3c798a7d382 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.750945 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 276/547] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:20.751783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.757049 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.757841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.758129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.758408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.766145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.767671 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:20.781643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:20.782668 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:20.783807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 272/548] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:20.784458 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.844599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e174af1-a117-42dc-8c59-715b9be46d83 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.876522 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218347c-dd5a-49d9-9a0c-2760fbe209e2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:20.876669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.877322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.877603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.877882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.878601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:20.878908 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.880316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.891117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 277/549] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:20.891866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.908990 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:20.909678 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:20.909957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:20.910295 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:20.911041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:20.911337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:20.912800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:20.921022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 273/550] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:20.921807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:20.987818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20734b-badc-4d27-9c66-0821ab7b35a1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.018381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044c602-c57a-4654-a3f8-7f4889f4f072 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.019330 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.020130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.020433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.020703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.030807 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:21.038472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.040108 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 278/551] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.045810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.050913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.051612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.051900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.052184 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.053019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.053327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.054795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.071670 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 274/552] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.072450 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.135862 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2680a-5814-4f5a-8dd7-bd499d2d5ddb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.163720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19277975-51ec-47b1-81b5-12a068846dd5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.167683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.168459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.168742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.169021 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.176150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.177596 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:21.194800 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.196401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:21.197271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 279/553] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.197824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.203989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.204796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.205436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.205951 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.218533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.220024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:21.236926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.237763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.238592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:21.238592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:21.238592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.238592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:21.238592 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 275/554] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.239113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.298170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda225a6-9dfd-4d37-8758-ed4237a009fc None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.330725 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.331410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.331695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.331971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.332705 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.333010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.334385 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.339555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd6c-acea-41ba-b031-fd0247bcfaf6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.342166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 280/555] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.342720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.371125 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.371930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.372210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.372482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.382278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.384351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:21.400542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.401369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.402484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:21.402484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:21.402484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.402484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:21.402484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 276/556] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.402902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.439425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50347b89-43bb-4678-b0ed-9e3f82a4bab2 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.472477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.473151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.473436 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.473718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.474551 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.474861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.476322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.493792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 281/557] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.494577 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.495585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ee2bd-54d3-4867-8f7f-29d7f4dd76ad None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.528271 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.528925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.529208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.529484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.530227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.530530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.531943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.543684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 277/558] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.544476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.589600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026eae-dc94-43b6-be17-9f777371b888 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.623130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.623939 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.624218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.624506 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.634204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.635688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.642254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0672d-3528-4763-b53e-7f57ace08d90 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:21.652468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.653454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 282/559] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.659086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.675107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.675794 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.676079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.676360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.677076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.677380 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.678750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.689874 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 278/560] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.690645 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.747553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09146-54ff-4e89-b19c-05c3e07a1ebc None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.778789 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.779589 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.779867 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.780137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.784308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd443c-45f9-48c5-a7c5-a4853951e974 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.790181 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.791636 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:21.808333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.809197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.810042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:21.810042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:21.810042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:21.810042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:21.810042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 283/561] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.810708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.816176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.816966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.817248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.817524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.825275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.826702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:21.840496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.841446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 279/562] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.842834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.906191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bded08-781f-454e-820c-7aad0139a53b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.933895 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529864a-423a-4f15-9de3-f8d9cc757f16 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:21.937512 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.938157 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.938437 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.938710 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.939438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:21.939741 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.941101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.952139 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 284/563] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:21.952919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:21.967197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:21.968055 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:21.968548 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:21.969028 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:21.975855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:21.977911 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:21.994197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:21.995241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 280/564] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:21.996558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.049646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db52e9-150c-4ef1-ac67-39ec0a7583d5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.080625 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.081270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.081551 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.081833 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.082536 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.082942 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.084323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.090214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83730f-2fa0-4980-a1a6-42c960dd94d3 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.095915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 285/565] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.096697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.122642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.123408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.123726 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.124044 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.124981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.125362 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.126801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.143771 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 281/566] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.144368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.188389 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679357-96d7-4961-b08e-69f88b2cf3c3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.220233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.221005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.221283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.221552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.228223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.229627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.235319 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3adb-fa29-4112-8346-597f61e3fea1 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:22.243663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:22.244635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 286/567] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:22.245562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.268195 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.268885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.269160 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.269430 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.270207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.270511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.271963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.283303 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 282/568] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.284100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.339761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed169-6b18-400b-b1ca-536d76b905d9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.370579 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.371344 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.371653 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.371924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.376844 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9c0-f0e5-4716-9211-668db2d9163f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.378197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.379648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:22.393716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:22.394723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 287/569] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:22.395982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.408681 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.409460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.409742 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.410013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.419977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.421409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:22.437440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:22.438318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:22.439229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:22.439229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:22.439229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:22.439229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:22.439229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 283/570] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:22.439818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.496738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de1c1-76a5-4240-acf3-ba8f7c0f165b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.529326 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.530050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.530335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.530617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.531475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.531779 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.533192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.536743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b68a76-3729-43ef-ad9f-52b40b26bd02 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.553698 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 288/571] 10.222.0.58 () {56 vars in 1139 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.553698 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.567949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.568821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.569098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.569369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/68d73b4a0e1646a19c1c70479a98a736/roles/e1e2d4a790984f15a5beea7979ffd19d` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.583486 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=68d73b4a0e1646a19c1c70479a98a736, role_id=e1e2d4a790984f15a5beea7979ffd19d)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.584913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.596373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 284/572] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:50:22 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/68d73b4a0e1646a19c1c70479a98a736/roles/e1e2d4a790984f15a5beea7979ffd19d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:22.597166 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.652383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac5c7-e33b-4a2c-81ca-dc49fb4c8b07 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.687175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.688100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.688286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.688600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.689507 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.689755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.691267 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.700641 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd017-e33a-40f4-a1a4-9faef9d181ca None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.704433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 289/573] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.710274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.735445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.736214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.736604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.736892 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.737622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:22.737946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.739308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.751828 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 285/574] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:22.752750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.812026 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec99a-1fbd-4db0-9680-11fe40217b4f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.844651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.845431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.845706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.845976 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.853277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260bc9-034f-499e-bb44-abb4238c2bd2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:22.856130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.857556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:22.874554 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:22.875658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 290/575] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:22.876552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.889192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:22.890322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:22.890774 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:22.891214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/29e72d051cbc4630a7e0e197a6df5369/roles/e1e2d4a790984f15a5beea7979ffd19d` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:22.905302 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=29e72d051cbc4630a7e0e197a6df5369, role_id=e1e2d4a790984f15a5beea7979ffd19d)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:22.906750 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:22.931462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 286/576] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:50:22 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/29e72d051cbc4630a7e0e197a6df5369/roles/e1e2d4a790984f15a5beea7979ffd19d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:22.933016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:22.979069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234342b9-bdb4-4612-a536-e0a977dddd1a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.016777 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.017571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.017849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.018121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.025671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.027158 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:23.043004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:23.044076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:23.044984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 291/577] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:23.050706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:23.052758 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bf6c-be13-423b-8941-2bcf5fd0a532 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.090960 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.092089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.092656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.093141 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.094098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:23.094622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.096312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.118438 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 287/578] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:23.120403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:23.167621 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399846d2-1e9b-42f3-beb8-03198ac72d67 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.204339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.205508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.205943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.206368 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.207312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:23.207793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.209471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.222100 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 292/579] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:23.230362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:23.236465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3c85-c8af-4283-993f-8a82388de7de None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.270930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.271905 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.272287 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.272900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.280924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.282497 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:23.300577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:23.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:23.302751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:23.309557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 288/580] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:23.310531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:23.349127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcce7c-ba9d-44c7-978d-e669d78db93a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.383760 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.384643 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.384921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.385193 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/24d4c4c8b0c740eeb45cae6aca0cc01c/roles/e1e2d4a790984f15a5beea7979ffd19d` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.399611 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=24d4c4c8b0c740eeb45cae6aca0cc01c, role_id=e1e2d4a790984f15a5beea7979ffd19d)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.401225 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.414394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6006b-b543-477a-aa1f-93fc46a7fb0f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.420391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 293/581] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:50:23 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/24d4c4c8b0c740eeb45cae6aca0cc01c/roles/e1e2d4a790984f15a5beea7979ffd19d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:23.458441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.459262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.459767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.463287 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.464439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:23.464764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.466249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec87df-180d-4b59-a05e-d86b7e549f94 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.480207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 289/582] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:23.486220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:23.601116 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70119-f554-4620-87bc-422a7ba92336 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:23.639040 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:23.639958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:23.640369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:23.640651 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/5f1f023aee544e4fa1c31808f7b3ba4e/roles/e1e2d4a790984f15a5beea7979ffd19d` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:23.655136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=5f1f023aee544e4fa1c31808f7b3ba4e, role_id=e1e2d4a790984f15a5beea7979ffd19d)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:23.656682 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb6451-e907-4c6f-81e7-65fdac1fc512 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:23.671803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 294/583] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:50:23 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/5f1f023aee544e4fa1c31808f7b3ba4e/roles/e1e2d4a790984f15a5beea7979ffd19d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:50:24.950165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a5b3-0b0f-4851-b541-e3c8914c4d57 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:24.950718 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a5b3-0b0f-4851-b541-e3c8914c4d57 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:24.950718 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a5b3-0b0f-4851-b541-e3c8914c4d57 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:24.952429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 290/584] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:24.958319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:24.958784 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:24.958869 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:24.977117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:24.978286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:25.045431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 295/585] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:25.069529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a5b3-0b0f-4851-b541-e3c8914c4d57 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.173663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a5b3-0b0f-4851-b541-e3c8914c4d57 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.216254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.216974 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.217257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.217530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.227930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-46cfc7bc-16db-4222-883b-5ed14223ede7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:25.235752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:25.236985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:25.237825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 291/586] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:25.244518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.344855 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118de3-7658-4739-88d7-56f162e198ea None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.383723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.384393 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.384679 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.384959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.385704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:25.386010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:25.387411 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:25.392349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf291-4794-49c1-b75d-2af2c35cff9e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.392639 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf291-4794-49c1-b75d-2af2c35cff9e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.392926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf291-4794-49c1-b75d-2af2c35cff9e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.394538 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 292/587] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:25.396282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 296/588] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:25.401365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.401652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.401930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.404120 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.423499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:25.424759 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:25.510027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 293/589] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:25.525532 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543efb-de3d-4ea6-a769-b72614977b71 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.534454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.567436 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.568793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.569328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.569861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.584595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:25.586495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:25.604211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:25.605170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:25.606060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:25.606060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:25.606060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:25.606060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:25.608419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 297/590] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:25.613924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.655142 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e13c3-e975-4052-becc-4035c0f60a6e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.688757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.689547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.689832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.690108 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.701233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:25.709467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:25.710418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:25.712169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:25.715606 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 294/591] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:25.717276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.721763 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3594b7-d2ea-4e69-b87e-b2e659e224e5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.755820 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.756402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.756685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.756961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.757699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:25.758004 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:25.759417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2534-1766-4b4e-b1bc-a727cc36538a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:25.770632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 298/592] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:25.771899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191901fb-90be-42fc-bcbd-8d5ded015c9f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.772187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191901fb-90be-42fc-bcbd-8d5ded015c9f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.772453 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191901fb-90be-42fc-bcbd-8d5ded015c9f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.774409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 299/593] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:25.780522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.780807 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.781081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.797401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:25.798591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:25.824899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e371a42-8708-497a-832f-f901ead83ea0 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.860675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:25.861368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:25.861654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:25.861933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:25.862683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:25.862989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:25.864409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:25.869872 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 300/594] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:25.870877 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.883536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 295/595] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:25.888569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:25.973578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5b07b-935d-483b-a641-7275edbf6a8d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:25.986567 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38b84-1b7e-4dde-80da-4d4de7b0debf None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.008877 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.009668 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.010137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.010613 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.019197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.019702 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.020010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.020291 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.020563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.021141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.031059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.032493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:26.035759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.036830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 301/596] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.042481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-4a5e1459-a6e6-4736-b83f-e47d5069831e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:26.048636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.049524 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.050516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:26.050516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:26.050516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.050516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:26.050516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 296/597] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:26.050972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf992a4-4121-47ba-86ee-bace99a3d3d2 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.051229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf992a4-4121-47ba-86ee-bace99a3d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.051529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf992a4-4121-47ba-86ee-bace99a3d3d2 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.052913 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 297/598] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:26.053417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf992a4-4121-47ba-86ee-bace99a3d3d2 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.137717 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66206c2-130d-433a-8c77-a0f4000f287c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.146788 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf992a4-4121-47ba-86ee-bace99a3d3d2 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.169959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.170734 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.171013 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.171284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.178144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.178972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.179251 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.179551 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.180376 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:26.180678 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.180852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:26.182163 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfa9c5-df44-419e-84e1-018bc2b4a165 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:26.188442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.189519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 302/599] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.190363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.201201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 298/600] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:26.202446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.202732 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.203009 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.219144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:26.220371 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:26.283958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 299/601] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:26.284710 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.287034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65ec6-4d5a-409c-a653-183dfb7045cb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.325030 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.325689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.325969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.326243 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.326958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:26.327262 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.328665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.340216 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 303/602] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:26.341162 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.390581 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cce508-1add-4d7c-8519-917f092cf344 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.422099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.422824 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.423170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.423544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.424277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:26.424580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.425949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.434010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 300/603] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:26.434790 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.441178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3e22-0940-491d-95e1-624a73a0e361 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.474133 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.474768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.475058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.475326 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.528192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420fa3d-00d0-487e-bd4f-d396e7ccfd8b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.538061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.539491 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.559133 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.559879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.560159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.560429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.569886 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:26.578219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.579325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 301/604] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.585406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.630632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 304/605] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:26.631472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.678928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783badc-eb17-4b3b-acd8-b8b5d9c3731e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.710358 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.711226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.711545 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.711824 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.718866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.720327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.721866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75db5d-2338-42b5-a91d-007cd69bbaab None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:26.734441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.735533 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 302/606] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.741434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.754369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.755142 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.755459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.755734 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.765308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.766735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:26.783605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.784685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 305/607] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.785565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.831696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08256a-9cab-4314-bec2-68a510e0daa1 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.862769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.863452 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.863737 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.864018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.864752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:26.865059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.866416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.874407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 303/608] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:26.875171 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.878307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba29e-5b43-4485-ad0c-111574129da6 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:26.910571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:26.911341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:26.911675 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:26.911950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:26.921942 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:26.923380 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:26.940587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:26.941620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 306/609] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:26.942652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:26.973503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff8415-c662-4345-a7c7-49f90de92a48 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.005289 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.005950 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.006236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.006508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.007331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.007693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.009119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.025630 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 304/610] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.026411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.035458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527270f7-0595-433d-a016-84f397d1f2cb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.067482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.068121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.068397 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.068668 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.069363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.069662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.071558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.082300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 307/611] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.083044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.119035 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9301e1-3dad-4f71-9395-4bd20e2ee93d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.150673 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.151472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.151752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.152024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.161523 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.163010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.173975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c800c-7088-48c8-b223-3a4ea7961cc6 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:27.180051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:27.181122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:27.182004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:27.182004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:27.182004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:27.182004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:27.182004 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 305/612] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:27.182284 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.206324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.206977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.207259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.207583 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.208304 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.208611 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.209954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.221212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 308/613] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.221991 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.283500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5476-b2d1-40dd-8068-65a8d00424ba None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.313073 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13074f95-c702-41d2-b934-73b5113ae185 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.314547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.315182 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.315504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.315783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.345434 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.346304 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.346595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.346875 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.354190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.356171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:27.372255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:27.373379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 309/614] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:27.374513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.382119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.384255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.466027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6ac9-e78f-4259-b56e-acfcab6f2f1f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.475694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 306/615] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:27.476940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.500475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.501119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.501396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.501667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.502372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.502679 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.504071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.514567 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 310/616] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.515335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.571126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26bcd8-bfdf-4d44-8e83-588e2ba5000b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.602652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.603389 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.603670 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.603946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.606816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e291c0-4891-4004-abbd-9cce4ceb4781 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.610407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.611920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:27.626146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:27.627165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 307/617] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:27.633202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.639720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.640384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.640682 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.641018 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.641774 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.642079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.643534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.659886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 311/618] 10.222.0.58 () {56 vars in 1137 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.660582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.725785 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2016df-aa18-4aaf-a650-1cbce836746b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.754703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef01f9c-ce7b-42e8-a399-a62ebc7adb2f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.757420 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.758284 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.758575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.758850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.768735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.770189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.785982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.786748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:27.786925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:27.787835 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:27.788684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:27.788684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:27.788684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:27.788684 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:27.789464 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.789464 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.790015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 308/619] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:27.790015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.798602 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.800047 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:27.814299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:27.815204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 312/620] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:27.820375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.881901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a329-0ee2-4319-9545-c5c4acd110fc None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.908728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c264-7e1e-42a3-beb5-600f451fca1a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:27.912918 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.913566 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.914446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.914849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:27.916108 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:27.916586 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:27.918934 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:27.935192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 309/621] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:27.936493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:27.946824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:27.947715 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:27.948000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:27.948282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.019196 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.020673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.028996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98ddd-4d63-449c-b9e0-c6a3f2e44c2d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.063133 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.063805 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.064086 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.064358 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.065060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.065359 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.066728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.078143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 310/622] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.078945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.118068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 313/623] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:28.118949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.170857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eaaa9-04e9-45ae-9604-b94b8463af90 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.202050 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.202707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.202983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.203256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.204107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.204409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.206072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.212793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ecb0-9d80-4835-9158-27205387391d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.222436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 311/624] 10.222.0.58 () {56 vars in 1139 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.223212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.246287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.246932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.247209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.247513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.248333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=68d73b4a0e1646a19c1c70479a98a736) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.248641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.250082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.256161 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 314/625] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/role_assignments?user.id=68d73b4a0e1646a19c1c70479a98a736&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.256995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.335516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764501e-9b1f-450a-9b15-9968e9414c84 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.366155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d493-dbd0-4ec2-9592-16bf10471a69 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.371253 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.372097 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.372381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.372657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.379898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.381393 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:28.395629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:28.396784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:28.397714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 312/626] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:28.398253 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.406315 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.407451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.407930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.408447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.420653 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.422522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:28.441227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:28.442841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 315/627] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:28.443775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.515158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69edf-55bd-4aba-a55a-bd514afe993d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.552656 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a570e-c806-42c5-a13e-a7f8de12254c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.553062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.553867 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.554468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.555569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.586401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.587197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.587612 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.587993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.588885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.589290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.590818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.603501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 316/628] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.604506 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.621126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.623443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.703067 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4d7c-a046-4244-ae64-6389981907a9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.725588 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 313/629] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:28.725588 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.741003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.741810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.742180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.742556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.743344 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.743757 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.745235 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.756254 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 317/630] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.757253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.817520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471065-1dcd-4976-bdd4-68fef3337496 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.850713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.851944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.852229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.852509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.853327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=29e72d051cbc4630a7e0e197a6df5369) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:28.853654 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.855079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.856172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d019c3-65e2-47c6-b69b-d557904ccdd7 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:28.871700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 314/631] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/role_assignments?user.id=29e72d051cbc4630a7e0e197a6df5369&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:28.871700 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.892028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:28.892823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:28.893104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:28.893377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:28.905463 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:28.906946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:28.925281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:28.926233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:28.927111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:28.927111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:28.927111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:28.927111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:28.927111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 318/632] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:28.933253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:28.993713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0accc-86a5-4659-9bc0-d86aefcf990f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.030003 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.030975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.031373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.031813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.040007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.041748 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.047564 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c37b5b-0855-4263-b789-86815c7b9b6c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:29.057894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:29.059757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:29.061208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 315/633] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:29.067224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:29.091890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.092569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.092876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.093152 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.093946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:29.094252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.095772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.110691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 319/634] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:29.116705 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:29.180265 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfcfd-cead-457a-b4e5-6d57b65b62a8 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.223302 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.224587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.224969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.225479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.226972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:29.227518 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.229613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.236646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425924d6-c0ea-430b-a9e4-cfc40412bb0e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.244491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 316/635] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:29.250001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:29.284061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.286104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.286783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.287261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.297149 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.299319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:29.317336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:29.318211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:29.319080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:29.321145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 320/636] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:29.329387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:29.353542 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca893-0f44-4b3d-966e-91bb19e9fcf1 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.388970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.390024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.390500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.390968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.392014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=24d4c4c8b0c740eeb45cae6aca0cc01c) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:29.392520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.394156 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.401098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 317/637] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:29 2022] GET /identity/v3/role_assignments?user.id=24d4c4c8b0c740eeb45cae6aca0cc01c&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:29.440402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519fc92-fa24-4c65-b306-c49be79e24ab None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.486605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.487773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.488230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.488665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.489665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:29.490148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.492152 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a2bb-4c2e-4622-8162-59012b7618a7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.506587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 321/638] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:29.512661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:29.623674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2c9bd-6751-4585-9f06-1b2db8514583 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:29.657362 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:29.658018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:29.658307 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:29.658586 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:29.659449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=5f1f023aee544e4fa1c31808f7b3ba4e) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:29.659768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:29.661290 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085115b3-4d3f-44ca-b920-93cd8d36fc46 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:29.667310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 318/639] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:29 2022] GET /identity/v3/role_assignments?user.id=5f1f023aee544e4fa1c31808f7b3ba4e&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:30.713119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7a72-1bf9-4fef-a3a6-b3eb7adb8581 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:30.713631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7a72-1bf9-4fef-a3a6-b3eb7adb8581 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:30.713631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7a72-1bf9-4fef-a3a6-b3eb7adb8581 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:30.715250 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 322/640] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:30.720582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:30.720972 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:30.721136 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:30.738403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:30.739536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:30.805979 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 319/641] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:30.829657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7a72-1bf9-4fef-a3a6-b3eb7adb8581 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:30.931914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7a72-1bf9-4fef-a3a6-b3eb7adb8581 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:30.965521 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:30.966307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:30.966587 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:30.966863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:30.977363 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:30.984953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:30.985926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:30.986899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 323/642] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:30.992247 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.088301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668d5e-d674-4e1b-9eaf-7cdf2a542104 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.121321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.121981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.122262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.122536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.123268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:31.123662 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.125017 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.133878 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 320/643] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:31.139296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.245916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f97c9-6cfa-4e72-a0e5-4da3c58442e0 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.290667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.291462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.291821 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.303520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.303884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.305375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-4cdcd952-4890-48c3-b306-824f7e4f222e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:31.323646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:31.324790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:31.325671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:31.325671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:31.325671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:31.325671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:31.335379 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.343382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 324/644] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:31.407829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8f9c-b019-4bca-92a8-4c35ec9ae6e8 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.409756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8f9c-b019-4bca-92a8-4c35ec9ae6e8 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.409756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8f9c-b019-4bca-92a8-4c35ec9ae6e8 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.410669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 325/645] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:31.416648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.417061 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.417426 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.438569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f81c6-4774-4a90-b675-effc6e0251ec None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.440128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:31.442285 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:31.487309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.488430 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.488851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.489336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.490263 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:31.490712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.493659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.514183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 321/646] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:31.519859 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.536258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 326/647] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:31.568617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.644321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc5fb-6bb5-4de6-8a54-05f4e3c540e7 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.703262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.704784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.705319 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.705594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.724716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.728032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:31.751610 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:31.752653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:31.753587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:31.758250 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 322/648] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:31.761381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.761522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f4a4-cf84-49f7-b775-8de2f10cdfc0 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.820123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.821317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.821797 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.822269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] PATH_INFO: `/v3/services/image` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.823136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.824749 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:31.854135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:31.855287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:31.856189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:31.868811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 327/649] 10.222.0.58 () {56 vars in 1105 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/services/image => generated 86 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:31.870126 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:31.887900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2650-7116-4890-8a51-b94ba62c1ee5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:31.922367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:31.923033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.923315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.923675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.924506 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:31.924813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:31.926237 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245c03-c80e-4b71-af00-adafaefb34fb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:31.942554 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 323/650] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:31.943869 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81315-814f-4fd8-8649-67dd01eea2c4 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.944157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81315-814f-4fd8-8649-67dd01eea2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.944424 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81315-814f-4fd8-8649-67dd01eea2c4 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.946422 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 324/651] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:31.952546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:31.952883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:31.953169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:31.971032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:31.972377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:31.978829 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185c5a9-09bd-4536-9d39-f5be55456894 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.011453 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.012489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.012780 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.013068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.013776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.014081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.015489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.024865 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 328/652] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.024865 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.041515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 325/653] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:32.042271 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.126489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53c75-2dca-457d-addd-c3dda3da9ff7 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.134850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe88a4-3d21-4313-b101-b615f0585329 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.158244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.158883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.159182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.159482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.165953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.166597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.166876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.167151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.167883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] RBAC: Adding query filter params (type=image) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.168177 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.169529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5a744-b7ce-4e77-999e-2139d1e7c2e6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.174752 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 326/654] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.176027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7228-b0b1-4f52-bb88-1de4b4a1510f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.176318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7228-b0b1-4f52-bb88-1de4b4a1510f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.176590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7228-b0b1-4f52-bb88-1de4b4a1510f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.177822 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 327/655] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:32.178530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7228-b0b1-4f52-bb88-1de4b4a1510f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.232645 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.234131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b2987-6ae4-4505-a2d6-46c17682003d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.291444 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7228-b0b1-4f52-bb88-1de4b4a1510f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.326760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.327645 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.327929 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.328202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.328848 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.330523 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.343027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 329/656] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 16:50:32.343027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.343027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.343027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:32.354204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:32.355228 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.356451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 328/657] 10.222.0.58 () {56 vars in 1129 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:32.357761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.358405 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:32.359638 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:32.432030 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 330/658] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:32.436275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.465918 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950672-1eae-4ad7-a95f-646fd8f31998 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.501630 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.502418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.502698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.502971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.513298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.514787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:32.531876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:32.532812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:32.533724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:32.533724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:32.533724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:32.533724 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.537502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 329/659] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:32.538271 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.541320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643d8b-6efa-48a0-ac5a-846afb3cdb80 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.575656 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.576321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.576610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.576888 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.577591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.577898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.579266 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.588476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 331/660] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.588476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.644026 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7e5d-17a4-4ba6-b3e9-ab7d13548ab5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.685466 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f02a9-e5fe-4f56-b2e7-22b6ebc4d00d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.687605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.688407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.688691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.688966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] PATH_INFO: `/v3/services/network` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.689611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.691007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:32.702962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:32.704180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:32.710563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 330/661] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:32.711945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.724150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.724814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.725095 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.725367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.726591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.726897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.728277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.744346 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 332/662] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.744501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.802785 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16671e-f0f2-431c-a955-d1c761c1f2eb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.835445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.836096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.836376 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.836644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.837331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.837638 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.837745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585715e-b0d5-4973-b61b-dd437e935ad6 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.839000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.851896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 331/663] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.851896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.874379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213823f-9082-4816-b594-11b09cba176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:32.875055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213823f-9082-4816-b594-11b09cba176f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:32.875335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213823f-9082-4816-b594-11b09cba176f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:32.875642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213823f-9082-4816-b594-11b09cba176f None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:32.876354 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213823f-9082-4816-b594-11b09cba176f None admin] RBAC: Adding query filter params (name=network) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:32.876718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213823f-9082-4816-b594-11b09cba176f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:32.878199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213823f-9082-4816-b594-11b09cba176f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:32.883815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 333/664] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:32.890165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213823f-9082-4816-b594-11b09cba176f None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:32.963633 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1cf8-d56a-4f00-b49b-4b0d72f418ea None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:32.997852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213823f-9082-4816-b594-11b09cba176f None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:33.001932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:33.002762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:33.003045 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:33.003320 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:33.013987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:33.015551 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:33.031230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:33.033167 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:33.034348 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 332/665] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:33.043950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:33.043950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:33.044449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:33.044737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:33.044737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:33.044737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] RBAC: Adding query filter params (type=network) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:33.045485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:33.047422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:33.054050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 334/666] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:33.156056 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7f167-0eb6-459a-87ec-1e9e0d1d5988 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:33.192260 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:33.192941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:33.193218 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:33.193490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:33.194288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:33.194595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:33.196443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50641fd2-05de-48da-a988-2245d8893704 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:33.209657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 333/667] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:33.216292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:33.318322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801d26-ab1b-4621-b008-23dc15f28c32 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:33.354447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:33.355503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:33.356010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:33.356511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:33.357543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=68d73b4a0e1646a19c1c70479a98a736) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:33.358059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:33.360051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdbaf-fc99-428c-ad2e-a924b74e04e9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:33.366673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 335/668] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:33 2022] GET /identity/v3/role_assignments?user.id=68d73b4a0e1646a19c1c70479a98a736&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=df86ea59d76740488f867f6211ccfa28 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:34.517302 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ecbc-a109-4a82-9914-c84e296a53cb None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:34.517814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ecbc-a109-4a82-9914-c84e296a53cb None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:34.517891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357ecbc-a109-4a82-9914-c84e296a53cb None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:34.519329 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 334/669] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:34.524729 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f527-f143-4e00-93f5-6fb223cc90ec None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:34.525515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f527-f143-4e00-93f5-6fb223cc90ec None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:34.525996 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f527-f143-4e00-93f5-6fb223cc90ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:34.662172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-da15f527-f143-4e00-93f5-6fb223cc90ec None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:34.664311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-da15f527-f143-4e00-93f5-6fb223cc90ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:34.730571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 336/670] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:34.754389 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357ecbc-a109-4a82-9914-c84e296a53cb None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:34.858941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357ecbc-a109-4a82-9914-c84e296a53cb None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:34.893344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:34.894397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:34.894887 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:34.895383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:34.896310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:34.897938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a00c14-034d-4116-85ea-d2b78495d6bb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:34.915007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 335/671] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:34 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:50:35.220564 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c92-e2c5-42c8-8ae1-12e85b2094ca None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.220985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c92-e2c5-42c8-8ae1-12e85b2094ca None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.221165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c92-e2c5-42c8-8ae1-12e85b2094ca None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.222844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 337/672] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:35.228957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a0f9-06ad-43ee-b7a0-668829dcd482 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.229297 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a0f9-06ad-43ee-b7a0-668829dcd482 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.229522 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a0f9-06ad-43ee-b7a0-668829dcd482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.247728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d644a0f9-06ad-43ee-b7a0-668829dcd482 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:35.248939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d644a0f9-06ad-43ee-b7a0-668829dcd482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:35.322615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 336/673] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:35 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 16:50:35.346209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f74c92-e2c5-42c8-8ae1-12e85b2094ca None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:35.413140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f865-5a37-4387-8777-999d6041e41d None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.413423 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f865-5a37-4387-8777-999d6041e41d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.413739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f865-5a37-4387-8777-999d6041e41d None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.415233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 337/674] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:35.420121 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d393-253f-40ad-bf2b-3e192b3e4cc5 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.420408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d393-253f-40ad-bf2b-3e192b3e4cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.420686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d393-253f-40ad-bf2b-3e192b3e4cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.437302 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-df99d393-253f-40ad-bf2b-3e192b3e4cc5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:35.438469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-df99d393-253f-40ad-bf2b-3e192b3e4cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:35.454190 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f74c92-e2c5-42c8-8ae1-12e85b2094ca None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:35.498227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:35.500732 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.501188 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.501627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.502511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:35.509455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:35.535383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 338/675] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:35 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:35.536032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 338/676] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:35 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 16:50:35.553708 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:35.680338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388132a-ff3a-4be1-adb7-156bde7daa8d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:35.720454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016759fe-2481-4852-bec1-1e75b2fff028 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.720644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:35.720739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016759fe-2481-4852-bec1-1e75b2fff028 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.721007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016759fe-2481-4852-bec1-1e75b2fff028 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.721172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.721429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.721830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.722609 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:35.723624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 339/677] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:35.724079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:35.727800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:35.728082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:35.728358 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:35.738500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 339/678] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:35 2022] POST /identity/v3/services => generated 240 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:35.746686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:35.748142 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:35.839518 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 340/679] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:35.858967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:35.967105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b72c-30ed-4f31-a157-53524684e69c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.001485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.002193 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.002471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.002737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.013516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:36.021084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:36.022055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:36.023218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 340/680] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:36.030025 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:36.126031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643e9e7-d240-49c6-9776-e90ebed63f3d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.160314 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.161008 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.161296 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.161574 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.162343 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:36.162652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:36.164166 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:36.173442 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 341/681] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:36.180198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:36.283931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9ed8-3fdb-4ceb-b09c-99a858e06309 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.318069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.319195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.319756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.320719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.331876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:36.333640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:36.351230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:36.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:36.353111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:36.353111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:36.353111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:36.353111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:36.358541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 341/682] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:36.359986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:36.478710 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6190-435f-40b8-ba9a-9ea01acf52e2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.530802 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.531496 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.535425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.535425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.535425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:36.535425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:36.535425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:36.567375 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 342/683] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:36.582920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:36.682250 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7994b8-0994-42da-8bf6-9de2e639b4b0 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.715570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.716359 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.716635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.716904 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.724726 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:36.726683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:36.740662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:36.742603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:36.744871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:36.747378 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 342/684] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:36.748789 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:36.848618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda4b1-b5d2-4f8e-a70a-2072d2e4b0fb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:36.881830 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:36.882552 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:36.882833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:36.883105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:36.883966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:36.884269 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:36.885688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:36.903951 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 343/685] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:36.909349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.008278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617ca8-f67b-4392-9451-c69c2824b882 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.042982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.043813 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.044088 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.044358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.056311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.057768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:37.075311 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:37.077374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:37.079544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:37.079544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:37.079544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:37.079544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:37.083400 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 343/686] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:37.084413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.189670 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ea78-585b-4002-ad08-abdf1817fd6b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.225819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.226511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.226794 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.227070 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.227894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:37.228200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.229559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf427c7-c76c-44e2-aaf8-84537b4dc50c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.241145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 344/687] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:37.246664 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.345182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261eec0-2aad-4d6b-8f20-252af02dd387 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.370659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa223c-5884-41c6-b278-fee8ae4d7b11 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.370659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa223c-5884-41c6-b278-fee8ae4d7b11 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.370659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa223c-5884-41c6-b278-fee8ae4d7b11 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.370659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 345/688] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:37.374600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.374891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.375171 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.379837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.380619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.380894 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.381162 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.388781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.390200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.392853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:37.394025 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:37.404292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:37.405155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:37.406273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 344/689] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:37.412642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.470550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 346/690] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:37.495400 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.526015 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105856-8995-448e-bdde-444b2b8dbcfa None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.561339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.562000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.562286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.562556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.563340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:37.563672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.565091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.579461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 345/691] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:37.585661 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.617248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d8ada-8d76-4617-8096-5bd6417ffbad None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.660840 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.661911 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.662764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.663193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.664040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.666236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:37.682099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:37.683282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:37.684791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:37.693467 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 347/692] 10.222.0.58 () {56 vars in 1105 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:37.695280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.697673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28514b3-732a-4082-9945-912a3db3d9d1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.732074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.732992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.733176 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.733435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/68d73b4a0e1646a19c1c70479a98a736/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.735761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=68d73b4a0e1646a19c1c70479a98a736, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.737179 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.759703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 346/693] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:50:37 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/68d73b4a0e1646a19c1c70479a98a736/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 16:50:37.826210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36e1d-7608-4072-8594-1de7fdc81ee9 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:37.864721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:37.865810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:37.866294 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:37.867329 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:37.868276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] RBAC: Adding query filter params (name=image) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:37.868825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:37.870435 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc25b-2228-4903-ac48-4beed3128a87 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:37.876094 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 348/694] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:37.882886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:37.986907 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591242-d67a-4779-9583-b149f85b4194 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.001076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be89-df4e-4ad1-8772-9678f8f6192c None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.001359 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be89-df4e-4ad1-8772-9678f8f6192c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.001638 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be89-df4e-4ad1-8772-9678f8f6192c None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.003105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 349/695] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:38.008487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.008837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.009119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.024143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.025102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.025580 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.026080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.026981 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] RBAC: Adding query filter params (type=image) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.027515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.029087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:38.029201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.030261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:38.034735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 347/696] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:38.045198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.108196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 350/697] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:38.132453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.172937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26802f-9cff-4c50-913e-07ef7daf5c93 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.216068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.217086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.217967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.218450 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.220073 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] RBAC: Adding query filter params (interface=public, service_id=bb97ff7f4b924a19b228f1dae134d961, region_id=RegionOne) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.220592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.222703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.237957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 348/698] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/endpoints?service_id=bb97ff7f4b924a19b228f1dae134d961&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:38.239015 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.246924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd9b0-d4c9-4b16-a1d5-8cb5750348b5 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.283586 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.284106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.284394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.284672 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.285378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.286865 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-b23b9108-0adc-41e4-9a26-f0a0d60b9590 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:38.300180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:38.301333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:38.302354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:38.306372 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 351/699] 10.222.0.58 () {56 vars in 1129 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:38.307634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a615-2701-4872-a88d-2ce47cf47541 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.307932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a615-2701-4872-a88d-2ce47cf47541 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.308211 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a615-2701-4872-a88d-2ce47cf47541 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.309669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 352/700] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:38.311507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a615-2701-4872-a88d-2ce47cf47541 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.355691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d00a1-13e2-4d15-943d-311e824964b8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.392325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.393148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.393434 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.393711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.394771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.396461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b77a7-cfe5-4608-bed7-04d3f9a13b66 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.407771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 349/701] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:50:38.409941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.410745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.411294 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.425900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a615-2701-4872-a88d-2ce47cf47541 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.438590 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:38.440691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:38.478971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.479790 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.480077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.480357 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.481216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.481411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.482938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.493518 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 353/702] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:38.494414 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.539170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 350/703] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:38.562399 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.617112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bd0e-9ef4-44a0-a1ac-6f5c22448b55 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.653642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.654302 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.654625 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.654921 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.655704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.656033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.657405 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.662614 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 354/704] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:38.669753 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.694324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33733e6-a347-4147-bd42-c81b5f4cf295 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.741046 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.742634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.742919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.743452 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] PATH_INFO: `/v3/services/network` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.744488 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.746101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:38.761419 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:38.763481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:38.764916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:38.767638 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 351/705] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:38.770623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.786633 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6ffc-7d96-47e8-a037-afbe60a2c860 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.821859 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.822526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.822813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.823093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.823923 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] RBAC: Adding query filter params (interface=public, service_id=a0fa93881b444c77a3e6aa86203a333e, region_id=RegionOne) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.824239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.825615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.838028 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 355/706] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/endpoints?service_id=a0fa93881b444c77a3e6aa86203a333e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:38.838896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.892136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396bea-3f3f-43b8-9c9b-5fcf00565e97 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:38.926125 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:38.926893 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:38.927249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:38.927624 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:38.928388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] RBAC: Adding query filter params (name=network) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:38.928772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:38.930755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:38.935849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 352/707] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:38.941612 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:38.955852 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bec3f-716c-4322-89d9-ac3a8a7f300c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:39.003900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:39.004841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:39.005402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:39.005690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:39.006435 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:39.008082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:39.015571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 356/708] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:50:39.051824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568fc0c-f0af-4711-8069-00c52e22fb67 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:39.090242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:39.090927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:39.091275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:39.091590 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:39.092531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] RBAC: Adding query filter params (type=network) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:39.092733 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:39.094324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:39.100542 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 353/709] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:39.107436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:39.338390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92f905-ac29-4179-9973-d312f01d5723 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:39.372240 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:39.372903 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:39.373186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:39.373465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:39.374255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] RBAC: Adding query filter params (interface=public, service_id=fd77069fbc5a4297b8e78fed863a1e5f, region_id=RegionOne) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:39.374564 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:39.375969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f03ed-f08f-4d58-b724-7ef4dfeb4208 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:39.381388 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 357/710] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:50:39 2022] GET /identity/v3/endpoints?service_id=fd77069fbc5a4297b8e78fed863a1e5f&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:39.387344 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:39.490749 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5c4-7de7-4113-a4e2-e8751b7fff20 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:39.525339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81239384-2b43-4931-8760-84199279c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:39.526002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81239384-2b43-4931-8760-84199279c242 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:39.526287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81239384-2b43-4931-8760-84199279c242 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:39.526566 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81239384-2b43-4931-8760-84199279c242 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:39.527248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81239384-2b43-4931-8760-84199279c242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:39.528640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81239384-2b43-4931-8760-84199279c242 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:39.534462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 354/711] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:50:39 2022] GET /identity/v3/services => generated 1002 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:50:40.192989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7f37-df07-48ca-80c0-590017b30690 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.192989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7f37-df07-48ca-80c0-590017b30690 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.192989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7f37-df07-48ca-80c0-590017b30690 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.192989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 358/712] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:40.202151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.202151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.202151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.225048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:40.226715 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:40.303444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 355/713] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:40.328712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7f37-df07-48ca-80c0-590017b30690 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:40.434011 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7f37-df07-48ca-80c0-590017b30690 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:40.468885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:40.470280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.470784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.471113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.484239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:50:40.492477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:40.493981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:40.495559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 359/714] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:40.505898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:40.618257 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9259a30-a6b7-4925-87dc-6c5213e9fab3 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:40.652175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:40.652840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.653122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.653395 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.654137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:40.654441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:40.655844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0798937-ce79-4334-93e7-7910f98b666c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:40.664832 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 356/715] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:40.670315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:40.768129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f7b8-7b4c-436f-adf4-6f9ae64a633f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:40.775091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f792-16f8-4b0c-9b7d-9042541f68c3 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.775439 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f792-16f8-4b0c-9b7d-9042541f68c3 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.775697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f792-16f8-4b0c-9b7d-9042541f68c3 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.777468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 357/716] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:40.782999 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.783276 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.783591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.801970 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:40.803329 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:40.817363 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:40.818507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:40.818983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:40.819482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:40.831465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:40.833791 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:40.853576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:40.854511 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:40.855453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:40.855453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:40.855453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:40.855453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:40.857705 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 360/717] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:40.863363 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:40.876801 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 358/718] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:40.901901 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:40.974580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f220-ea85-46d0-89ca-a06b2902ca0e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.009621 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad87-2f7b-4b08-a27c-5b17211fcf06 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.016074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.016736 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.017016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.017403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.018116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:41.018473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.020280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.035115 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 361/719] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:41.040231 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.053208 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.054447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.054951 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.055492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] PATH_INFO: `/v3/services/image` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.056415 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.058038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:41.070712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:41.071927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 16:50:41.072810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.080370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 359/720] 10.222.0.58 () {56 vars in 1105 bytes} [Wed May 11 16:50:40 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:41.081454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.141667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3de5d-0e93-43f1-8e42-e8ddc66a031c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.175061 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.175917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.176200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.176472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.183537 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801fd56-121d-4b23-8120-ab874cbae61d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.183855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.185381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:41.199811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:41.201199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 16:50:41.202127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:41.205924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 362/721] 10.222.0.58 () {56 vars in 1093 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:41.206909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.223201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.224615 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.225093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.225541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.226450 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] RBAC: Adding query filter params (name=image) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:41.226964 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.228519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.233508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 360/722] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:41.239120 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.328950 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70115-6b22-4b87-8ca3-38adcd3bba13 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.343499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c835-07a8-4293-aea4-a35d621d4a4a None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.364334 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.364922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.365186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.365459 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.366385 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:41.367128 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.368688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.380076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.381015 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.381526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.382053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.383513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] RBAC: Adding query filter params (type=image) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:41.384031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.385590 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.390917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 363/723] 10.222.0.58 () {56 vars in 1133 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:41.391755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 361/724] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:41.391962 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.398630 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.514856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d923f3-566c-4767-a0d4-fb7d2882da7e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.520726 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7472be-c73e-4fd1-965d-6d4197456029 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.547315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.547995 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.548279 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.548557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.553248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.554402 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.554694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.554969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.555739 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.557123 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf667-af7e-407d-9fad-0fe18a1100dc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.585357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 362/725] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:50:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:50:41.585357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b233-628d-4c69-b5d6-da998948ec12 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.585357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b233-628d-4c69-b5d6-da998948ec12 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.585357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b233-628d-4c69-b5d6-da998948ec12 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.585357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 363/726] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:41.587704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.588011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.588266 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.605547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:41.606756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:41.634735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.637038 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.691846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 364/727] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:41 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:41.709367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.759089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 364/728] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:50:41.766546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.828799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b98ec-5890-41cb-982b-07c9d38cd6d4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.874738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.875490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.875770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.876042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.876691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.878053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.889908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559da5a-e749-4b91-8fb0-856484dca92a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:41.895438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:41.896383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 16:50:41.897226 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:41.900599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 365/729] 10.222.0.58 () {56 vars in 1129 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:41.906641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:41.928020 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:41.929577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:41.930036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:41.930307 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:41.940514 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:41.941968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:41.959853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:41.960809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:41.961689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:41.961689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:41.961689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:41.961689 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:41.965676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 365/730] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:41.966945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.017053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b3f3-89e1-425b-9f67-aed659f0ae34 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.053220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.054443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.055062 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.055540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.056645 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.057102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.059039 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125444db-feb2-476a-9e3c-5400bd4b4302 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.065491 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 366/731] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:42.067449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23440-753c-41cb-9104-8581775146d9 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.068150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23440-753c-41cb-9104-8581775146d9 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.068657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf23440-753c-41cb-9104-8581775146d9 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.070107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c282bf-f245-4d29-97d4-b5c98d584bc4 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.070650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 367/732] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:42.071682 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf23440-753c-41cb-9104-8581775146d9 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.104267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.104925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.105206 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.105482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.106198 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.106501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.107901 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e2c5-fb34-4121-b35c-b7b943ae2fce None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.123333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 366/733] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:42.124581 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.124922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.125192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.141722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:42.142977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:42.190142 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf23440-753c-41cb-9104-8581775146d9 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.222457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 367/734] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:42.224175 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.235183 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.235685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.235960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.236241 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.237003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.237308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.238730 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.245010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 368/735] 10.222.0.58 () {56 vars in 1124 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:42.250788 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.329705 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96e5f7-8242-4efa-ac22-dfdef0f7249e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.352088 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f2a9-8dd6-488a-b0a3-ebcdd412eb48 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.362084 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.362872 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.363158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.363464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.370694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.372164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.385269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.385855 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.386134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:42.386234 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:42.387076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:42.388000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:42.388514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.388514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.388648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.392042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 368/736] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:42.392738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.407468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 369/737] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:50:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:50:42.416547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.517666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dacc2-976d-4671-9f2e-f8eadf6eff35 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.549742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6288-b20c-41ab-ad83-86f752d5c5e8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.556785 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.557941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.558429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.558934 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.559821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.561418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:42.574317 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:42.575674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 16:50:42.576580 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:42.579340 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 369/738] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:42.585155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.590825 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.591853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.592367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.592848 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.593916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.594295 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.596424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.611783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 370/739] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:42.618184 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.706764 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1371-049e-4d62-a07b-4f9f6ed6e1b2 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.742479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.743448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.743876 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.744042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1e8f-398a-41c6-9a9e-948eb3a2915e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.744437 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.745285 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] RBAC: Adding query filter params (name=network) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.745902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.748263 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.753953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 370/740] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:42.759659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:42.778831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.779710 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.780097 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.780487 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.781418 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=68d73b4a0e1646a19c1c70479a98a736) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.781833 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.783391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.790320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 371/741] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/role_assignments?user.id=68d73b4a0e1646a19c1c70479a98a736&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=df86ea59d76740488f867f6211ccfa28 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:42.880318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ead5c-3d2c-4bfa-941e-9bfe1408981e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:42.917373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:42.918099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:42.918389 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:42.918667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:42.919404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:42.919717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:42.921112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5550-3b87-43f3-9feb-ae62802648e3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:42.926990 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 371/742] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:42.932570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:43.036854 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96d41-b4af-4ef6-8ef2-0c78a0da0524 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:43.071390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:43.072406 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:43.072906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:43.073386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:43.074315 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:43.075900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e3bb-0002-4509-a382-8fcc456e224f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:43.099446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 372/743] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:50:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:44.014077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f263d-43a7-4951-9637-54fe00c5b4d1 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.014649 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f263d-43a7-4951-9637-54fe00c5b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.014649 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f263d-43a7-4951-9637-54fe00c5b4d1 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.016155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 372/744] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:44.021304 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.021692 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.021856 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.038648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:44.039841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:44.111397 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 373/745] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:44.131628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f263d-43a7-4951-9637-54fe00c5b4d1 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:44.227803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f263d-43a7-4951-9637-54fe00c5b4d1 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:44.262165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:44.262834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.263114 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.263432 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.331091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:44.332490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:44.422515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 373/746] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:50:44 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:50:44.428148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:44.530302 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c4bc-3fd6-4d55-9471-0a4a1ee282c5 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:44.562145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:44.562924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.563198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.563629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.573705 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:44.575187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-67efcb19-2412-4748-85dd-2e752e6e67d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:50:44.592137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:44.593035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:44.593903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:50:44.593903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:50:44.593903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:50:44.593903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:44.595668 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 374/747] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:44.599310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:44.698445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5dd7-ba7a-4741-93e6-75d5e4d038f6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:44.731149 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:44.731831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.732112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.732380 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.733087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:44.733385 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:44.734736 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d11d6c-e306-4c17-a2ea-1ed7c546dee6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:44.746181 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 374/748] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:44.838207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0c69-1d7e-4561-a4c2-d3a9e41bbbdc None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.838552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0c69-1d7e-4561-a4c2-d3a9e41bbbdc None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.838771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0c69-1d7e-4561-a4c2-d3a9e41bbbdc None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.840372 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 375/749] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:44.846025 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:44.846282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:44.846521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:44.864423 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:44.865614 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:44.939031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 375/750] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:44.963799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0c69-1d7e-4561-a4c2-d3a9e41bbbdc None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.073341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0c69-1d7e-4561-a4c2-d3a9e41bbbdc None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.105080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.105805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.106089 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.106365 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.107011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.108514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-6164c513-2988-469f-a68a-6f2f302f02b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:45.120369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:45.121328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.122340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 376/751] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:45.127765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.172119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23333a0-2531-4f4c-b29b-70263fd5a243 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.172410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23333a0-2531-4f4c-b29b-70263fd5a243 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.172690 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23333a0-2531-4f4c-b29b-70263fd5a243 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.174023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 377/752] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:45.178762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.179598 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.179876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.196151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:45.197320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:45.220186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a705b-a04d-4421-a474-c7a1a3c20766 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.251192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.251868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.252145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.252417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.253109 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:45.253408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.254751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.259582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 376/753] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:45.260700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 378/754] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:45.265143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.282444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.357323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb001a-6fe6-4b98-bc35-20dc1452c207 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.377658 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88802b67-5dd0-453b-b0b9-7e5e171ee8b1 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.389573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.390222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.390512 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.390789 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.391519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:45.391825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.393193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.397393 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 377/755] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:45.410082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.410912 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.411192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.411499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.412163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.414067 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:45.426995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:45.428042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:45.428903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 379/756] 10.222.0.58 () {56 vars in 1132 bytes} [Wed May 11 16:50:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:45.435377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.534552 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7400cc-ff81-4219-b15a-a5d00974973a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.568679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.569351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.569671 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.569945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.570648 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:45.570955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.572365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c005-810e-42be-85ca-1f5b97299988 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.576888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 378/757] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:45.582783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:45.677063 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd3575-95a4-4c04-8315-ba4caf782476 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:45.710223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:45.710874 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:45.711156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:45.711461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:45.712155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:45.712458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:45.713801 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9ce8-6efd-4ddd-9b2a-080f2dc104d1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:45.718002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 380/758] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:47.657073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f9f-0188-46db-943d-70fff46f10f3 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:47.657602 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f9f-0188-46db-943d-70fff46f10f3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:47.657686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f9f-0188-46db-943d-70fff46f10f3 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:47.658978 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 379/759] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:47.664702 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899a06-a2b9-4909-8cec-1dfa1a9e710e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:47.665146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899a06-a2b9-4909-8cec-1dfa1a9e710e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:47.665241 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899a06-a2b9-4909-8cec-1dfa1a9e710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:47.681732 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-1a899a06-a2b9-4909-8cec-1dfa1a9e710e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:47.682881 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-1a899a06-a2b9-4909-8cec-1dfa1a9e710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:47.745454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 381/760] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:47 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:47.768364 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9f9f-0188-46db-943d-70fff46f10f3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:47.867612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9f9f-0188-46db-943d-70fff46f10f3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:47.898817 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:47.899957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:47.900464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:47.900946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:47.902275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:47.904051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a072cde-1daa-4161-9a7f-c97e76293d54 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:47.917920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 380/761] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:47 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:48.003105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eee9f-b244-44f7-a066-1e5c8b9db192 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:48.003335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eee9f-b244-44f7-a066-1e5c8b9db192 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:48.003645 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eee9f-b244-44f7-a066-1e5c8b9db192 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:48.005037 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 382/762] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:48.010895 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c7cc-ee01-41b0-ae35-a70185f935da None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:48.011189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c7cc-ee01-41b0-ae35-a70185f935da None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:48.011535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c7cc-ee01-41b0-ae35-a70185f935da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:48.029054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-cfa8c7cc-ee01-41b0-ae35-a70185f935da None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:48.030267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-cfa8c7cc-ee01-41b0-ae35-a70185f935da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:48.105499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 381/763] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:48 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:48.129293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eee9f-b244-44f7-a066-1e5c8b9db192 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:48.239599 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eee9f-b244-44f7-a066-1e5c8b9db192 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:48.282553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:48.283134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:48.283450 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:48.283876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:48.284992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:48.287101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747614f2-03a0-4c2a-8537-c1c1e7700981 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:48.303286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 383/764] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:48 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:50.226420 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477447-d1d4-464e-b131-c6dcff23a73b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.226985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477447-d1d4-464e-b131-c6dcff23a73b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.226985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477447-d1d4-464e-b131-c6dcff23a73b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.228355 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 382/765] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:50.233732 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.234113 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.234348 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.251081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:50.252481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:50.322149 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 384/766] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:50.348827 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a477447-d1d4-464e-b131-c6dcff23a73b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.448683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a477447-d1d4-464e-b131-c6dcff23a73b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.483187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.483966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.484248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.484520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.485189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.486552 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-32353c94-f240-44af-8756-32d84b57e059 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:50.498521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:50.499492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.500318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 383/767] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:50.505687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.560301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae02b-47d0-401e-8688-1a0d96c4cfe2 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.560589 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae02b-47d0-401e-8688-1a0d96c4cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.560870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae02b-47d0-401e-8688-1a0d96c4cfe2 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.562224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 384/768] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:50.566919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.567204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.567543 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.584280 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:50.585491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:50.597776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c829e6-b6e9-4b36-a455-8ab4edb82b43 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.629427 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.630076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.630358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.630633 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.631327 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:50.631694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.633657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.638137 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 385/769] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:50.643757 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.647970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 385/770] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:50.670965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.735230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9f3f0-56ae-47f2-9d64-f94ab26284bb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.760766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a7174-9d78-49f0-b6f5-0dab63cefea0 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.768503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.769159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.769449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.769722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.770416 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:50.770720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.772111 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.776652 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 386/771] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:50.782310 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.792783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.793581 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.793858 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.794135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.794772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.796148 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:50.808428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:50.809352 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:50.810413 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 386/772] 10.222.0.58 () {56 vars in 1132 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:50.815299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.874638 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa4beb-edb0-40ed-9bde-c5b7a1ee76ea None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.905042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ca6b-0aeb-4ca1-b295-98d2884da72a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:50.905636 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.906295 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.906574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.906846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.907665 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] RBAC: Adding query filter params (interface=public, service_id=08e12c9d847a48e3a5d8b80385d5687d, region_id=RegionOne) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:50.907974 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.909321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.914673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 387/773] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/endpoints?service_id=08e12c9d847a48e3a5d8b80385d5687d&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:50.920185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:50.938221 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:50.938877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:50.939159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:50.939464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:50.940159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:50.940461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:50.941809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:50.946514 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 387/774] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:50.952022 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:51.012352 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311680f5-1f36-4b59-a767-1574175e7176 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:51.042961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02713-97f0-49c0-8e91-e87124d7dd34 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:51.044094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:51.044747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:51.045028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:51.045301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:51.045969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:51.047317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:51.052962 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 388/775] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services => generated 1498 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 16:50:51.075122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:51.075836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:51.076117 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:51.076389 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:51.077105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:51.077409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:51.078813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:51.084554 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 388/776] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:51.091128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:51.192683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94bce-416f-4670-a96f-53b505045962 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:51.226720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:51.227398 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:51.227684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:51.227957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:51.228743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] RBAC: Adding query filter params (interface=public, service_id=42c456c35a1247b48c3d88a0bc334587, region_id=RegionOne) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:51.229050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:51.230407 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b336186-abec-4a2e-9994-85f2680f667f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:51.235999 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 389/777] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:50:51 2022] GET /identity/v3/endpoints?service_id=42c456c35a1247b48c3d88a0bc334587&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:51.241523 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:51.338150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be672d-125d-4d95-afb2-061a53ef5d3a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:51.369194 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:51.369841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:51.370117 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:51.370387 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:51.371055 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:51.372449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979fb8-7e38-48d8-a931-4107fbeee81a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:51.378029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 389/778] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:50:51 2022] GET /identity/v3/services => generated 1498 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:50:53.339765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6702a-651b-445b-ba6e-ca9c8f529847 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.340301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6702a-651b-445b-ba6e-ca9c8f529847 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.340301 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6702a-651b-445b-ba6e-ca9c8f529847 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.341659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 390/779] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:53.346888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.347310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.347483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.364086 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:53.365236 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:53.426160 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 390/780] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:53.449887 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6702a-651b-445b-ba6e-ca9c8f529847 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.549743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6702a-651b-445b-ba6e-ca9c8f529847 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:53.580992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:53.581772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.582050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.582322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.582958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:53.584342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-426a3f3a-e14f-4122-8001-26fec22e0472 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:53.597041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:53.598065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 16:50:53.598917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:53.599793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 391/781] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:53.606261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.642863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613e84-f917-4e0d-b918-91d041415cdf None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.643251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613e84-f917-4e0d-b918-91d041415cdf None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.643563 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613e84-f917-4e0d-b918-91d041415cdf None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.644910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 392/782] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:53.650604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.650890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.651171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.667213 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:53.668509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:53.698077 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27537dc-1fcb-41d3-a16b-1f6b92f642f9 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:53.733086 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:53.733642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 393/783] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:53.733779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.734001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.734272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.734963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:53.735260 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:53.736652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:53.745606 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 391/784] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:53.746656 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.756448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.839531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c9496-b2a6-4c43-8d65-19707b086df9 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:53.850040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5a2ba-55f9-4bd0-bc40-8cbdf5772f98 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:53.870732 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:53.871408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.871691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.871969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.872667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:53.872971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:53.874337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:53.879017 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 394/785] 10.222.0.58 () {56 vars in 1114 bytes} [Wed May 11 16:50:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:53.880771 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:53.881565 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:53.882330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:53.882597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:53.883227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:53.884606 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:53.885023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:53.896428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:53.898178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:53.899268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 392/786] 10.222.0.58 () {56 vars in 1132 bytes} [Wed May 11 16:50:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:53.903975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:53.982045 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f564-e7c0-40ab-a77d-7288f5b5a3bd None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:53.996202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20d74-5fa5-426f-ae75-eb351d470c41 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:54.014530 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:54.015178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:54.015503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:54.015781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:54.016513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:54.017863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:54.027119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:54.027821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:54.028176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:54.028463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:54.029150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:54.029446 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:54.030880 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:54.035423 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 393/787] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:54.041216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:54.043550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 395/788] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:50:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:50:54.142119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0392e2-6319-4021-ac50-85facf9567cb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:54.180961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:54.181634 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:54.181916 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:54.182187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:54.182890 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:54.183194 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:54.184598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77a3ab-356b-4ad3-b1ba-ea177c30bec5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:54.189779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 394/789] 10.222.0.58 () {56 vars in 1126 bytes} [Wed May 11 16:50:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:54.196156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:54.293282 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cbe4-6726-4d4a-a236-90579261be93 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:54.324212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:54.324863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:54.325146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:54.325422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:54.326166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:54.327548 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e038-4a43-4da4-b9db-2649e19d24e5 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:54.346650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 396/790] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:50:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:56.389216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c705329-f523-42ea-98a3-2c156490cbf7 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.389751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c705329-f523-42ea-98a3-2c156490cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.389751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c705329-f523-42ea-98a3-2c156490cbf7 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.391125 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 395/791] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:56.397594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b00d-117f-4523-8a14-4f6bdb0bba57 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.398022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b00d-117f-4523-8a14-4f6bdb0bba57 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.398156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b00d-117f-4523-8a14-4f6bdb0bba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.414968 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-f2e2b00d-117f-4523-8a14-4f6bdb0bba57 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:56.416180 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f2e2b00d-117f-4523-8a14-4f6bdb0bba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:56.490514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 397/792] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:56.516207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c705329-f523-42ea-98a3-2c156490cbf7 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:56.611908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c705329-f523-42ea-98a3-2c156490cbf7 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:56.622336 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e977-9b09-4380-8f5a-6171c0913ad9 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.622635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e977-9b09-4380-8f5a-6171c0913ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.622916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e977-9b09-4380-8f5a-6171c0913ad9 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.624510 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 398/793] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:56.629207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.629492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.629770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.644518 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:56.645105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.645383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.645657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.646160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:56.646543 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:56.647332 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:56.647851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:56.649255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING keystone.server.flask.common [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 16:50:56.665403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.sql.core [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 16:50:56.665403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 16:50:56.665403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [parameters: {'id': '4c193dc0a6d742e1a00bbc9a9a68e214', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 16:50:56.665403 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86709) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c193dc0a6d742e1a00bbc9a9a68e214.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c193dc0a6d742e1a00bbc9a9a68e214. May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result = self._query(query) May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application conn.query(q) May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 16:50:56.682208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result.read() May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 16:50:56.683212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application next(self.gen) May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application yield resource May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application next(self.gen) May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.session.rollback() May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.force_reraise() May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise self.value May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application session.commit() May 11 16:50:56.684322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._prepare_impl() May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.session.flush() May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._flush(objects) May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application compat.raise_( May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application flush_context.execute() May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 16:50:56.685313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rec.execute(self) May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 16:50:56.686259 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result = self._query(query) May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application conn.query(q) May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result.read() May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 16:50:56.687085 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [parameters: {'id': '4c193dc0a6d742e1a00bbc9a9a68e214', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.688010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:56.688806 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c193dc0a6d742e1a00bbc9a9a68e214. May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 396/794] 10.222.0.58 () {60 vars in 1140 bytes} [Wed May 11 16:50:56 2022] POST /identity/v3/projects => generated 262 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 16:50:56.689720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:56.712395 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 399/795] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:56.735851 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:56.782205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad569-2f8d-4950-99a9-27afe9745edd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:56.814067 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:56.814836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.815113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.815405 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.821719 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:56.823320 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:56.826938 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85d353-c2d9-4a96-90a0-a48617b1f820 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:50:56.836864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:56.837773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:56.838912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 397/796] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:56.843595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:56.864025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:56.864810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.865093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.865371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.866055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:56.868040 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:56.879249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:56.880697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:50:56.881841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 400/797] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:50:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:56.886194 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:56.938520 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820c6-2589-4527-a28f-76377cd1b001 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:56.969242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:56.969885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:56.970161 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:56.970438 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:56.971172 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:56.971504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:56.972944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:56.978125 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73936-8f7f-4612-ac87-cb78ebf37184 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:56.992768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 398/798] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:57.010417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:57.011093 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:57.011396 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:57.011672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:57.012390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:57.012696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:57.014096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ec0b-61f5-40ad-a2a2-dc5247dc645e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:57.019375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 401/799] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:50:57.025829 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:57.125257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302678b-aabf-4223-98f3-a0b82aa08a0a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:57.160987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:57.161652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:57.161933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:57.162205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:57.163504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:57.163810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:57.165176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2c96-fbd0-49a4-ac9f-cdd4d090cfd3 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:57.169992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 399/800] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:50:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:50:59.343565 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eddf9-e8f0-4840-976c-2b570d489a89 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.344092 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eddf9-e8f0-4840-976c-2b570d489a89 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.344092 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eddf9-e8f0-4840-976c-2b570d489a89 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.345672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 402/801] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:50:59.350703 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.351140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.351245 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.368332 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:59.369790 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:59.429926 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3d54-9051-45ee-8fcd-76c5ba30cd3d None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.430209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3d54-9051-45ee-8fcd-76c5ba30cd3d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.430482 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3d54-9051-45ee-8fcd-76c5ba30cd3d None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.431870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 403/802] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:50:59.434007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 400/803] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 16:50:59.436723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916d70-2722-49bc-b640-027315df542f None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.437013 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916d70-2722-49bc-b640-027315df542f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.437292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916d70-2722-49bc-b640-027315df542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.453654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-71916d70-2722-49bc-b640-027315df542f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:50:59.454816 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-71916d70-2722-49bc-b640-027315df542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:50:59.460693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:59.519079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 404/804] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:50:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:50:59.544355 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916d70-2722-49bc-b640-027315df542f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:59.554693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdec81-b601-4f21-9497-6541c061410d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:59.586698 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:59.587454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.587739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.588013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.588710 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:59.590131 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:59.603192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.sql.core [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 16:50:59.603192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 16:50:59.603192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [parameters: {'user_id': '646390101f6f43fab4f607343077fcdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 16:50:59.603192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86709) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result = self._query(query) May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application conn.query(q) May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result.read() May 11 16:50:59.610365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 16:50:59.611242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application next(self.gen) May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application yield resource May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application next(self.gen) May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.session.rollback() May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.force_reraise() May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise self.value May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application session.commit() May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 16:50:59.612255 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._prepare_impl() May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.session.flush() May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._flush(objects) May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application compat.raise_( May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application flush_context.execute() May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rec.execute(self) May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 16:50:59.613127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 16:50:59.614032 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result = self._query(query) May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application conn.query(q) May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application result.read() May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 16:50:59.614868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [parameters: {'user_id': '646390101f6f43fab4f607343077fcdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:59.615707 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 16:50:59.616536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.617471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 401/805] 10.222.0.58 () {60 vars in 1131 bytes} [Wed May 11 16:50:59 2022] POST /identity/v3/users => generated 160 bytes in 151 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:59.617856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:59.639168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916d70-2722-49bc-b640-027315df542f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:59.671478 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:59.672133 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.672415 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.672689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.673412 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:59.674766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:59.687091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 405/806] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:50:59 2022] POST /identity/v3/services => generated 242 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:50:59.715417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f36c08-b53c-436c-9946-bef60c59a48b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:59.760622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:59.761426 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.761709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.761985 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.770059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:59.771736 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-b0f3a66e-94ac-44ca-966b-7ab044b29fce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:50:59.787699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:50:59.788891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:50:59.794877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 402/807] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:50:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 16:50:59.795660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:50:59.895446 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9e2c4-ab9f-4a97-9a42-65a4e0668e9d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:50:59.927786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:50:59.928455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:50:59.928738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:50:59.929012 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:50:59.929807 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:50:59.930110 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:50:59.931539 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d15add-ae9b-4800-975c-0f628aa40ffc None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:50:59.965617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 406/808] 10.222.0.58 () {56 vars in 1101 bytes} [Wed May 11 16:50:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:51:01.974821 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c3b45-d873-4da7-9ecf-062ec1ef74d4 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:01.975847 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c3b45-d873-4da7-9ecf-062ec1ef74d4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:01.975955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c3b45-d873-4da7-9ecf-062ec1ef74d4 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:01.977328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 403/809] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:51:01.982514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:01.982930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:01.983071 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:01.999850 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:51:02.001022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:51:02.062810 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 407/810] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:51:01 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:51:02.086254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c3b45-d873-4da7-9ecf-062ec1ef74d4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:02.182504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c3b45-d873-4da7-9ecf-062ec1ef74d4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:02.213839 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:02.214616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:02.214902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:02.215179 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:02.215863 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:02.217229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:51:02.229515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:51:02.230644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:51:02.231501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 404/811] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:51:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:51:02.236627 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:02.329483 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c069-6232-4d2e-b0d7-f5a272762da4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:02.361538 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:02.362192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:02.362478 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:02.362756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:02.363497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:51:02.363808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:02.365168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:02.369689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 408/812] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:51:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:51:02.375323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:02.468485 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc49a0-c2dd-416e-8d2e-96c1590db701 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:02.500083 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:02.500674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:02.500955 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:02.501230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:02.501919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:51:02.502221 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:02.503600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:02.508342 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 405/813] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:51:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:51:02.514036 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:02.606885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51063b-e037-4044-ad7f-fd927faf5b2b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:02.637842 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:02.638477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:02.638756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:02.639030 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:02.639837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] RBAC: Adding query filter params (interface=public, service_id=c5ad65d495ea47e69bd4432a720cf1e4, region_id=RegionOne) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:51:02.640146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:02.641488 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f9a2-0b2e-4874-8cc8-43ced360cb6c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:02.646197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 409/814] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:51:02 2022] GET /identity/v3/endpoints?service_id=c5ad65d495ea47e69bd4432a720cf1e4&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:51:02.652151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:02.745898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3de8f0-cf15-4798-93f6-face395d565c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:02.777719 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:02.778300 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:02.778577 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:02.778849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:02.779544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:02.780891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db5d7-8741-4049-9a73-c8d4116dccd5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:02.786715 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 406/815] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:51:02 2022] GET /identity/v3/services => generated 1728 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:51:05.073543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54f29-315d-4814-ab52-93479ef870d1 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.074079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54f29-315d-4814-ab52-93479ef870d1 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.074079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54f29-315d-4814-ab52-93479ef870d1 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.075458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 410/816] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:51:05.080769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.081206 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.081326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.097515 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:51:05.098992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:51:05.162040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 407/817] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:51:05 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:51:05.186290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b54f29-315d-4814-ab52-93479ef870d1 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:05.281308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b54f29-315d-4814-ab52-93479ef870d1 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:05.315569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:05.316347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.316633 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.316908 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.317545 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:05.318892 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:51:05.330199 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:51:05.331622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:51:05.332886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 411/818] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:51:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:51:05.338068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:05.427144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae8f9-6118-4696-8175-9ab169e0bee6 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:05.457624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:05.458261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.458540 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.458811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.460031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:51:05.460331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:05.461693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:05.466227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 408/819] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:51:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:51:05.471775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:05.564946 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f986-e85a-440c-9f3f-a5e994bb1868 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:05.596309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:05.596883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.597168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.597448 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.598136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:51:05.598441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:05.599831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697ab6-e3a9-45e1-bc7f-f3d7371e898f None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:05.604371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 412/820] 10.222.0.58 () {56 vars in 1112 bytes} [Wed May 11 16:51:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:51:05.609917 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:51:05.702069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe3731-fe8e-4067-a83c-2aa9f862024d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:51:05.733664 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:51:05.734299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:51:05.734581 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:51:05.734853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:51:05.735607 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:51:05.736951 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc10df-ac63-4142-bb80-a0c3e8b3a74d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:51:05.756653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 409/821] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:51:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:52:08.213260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb10c30-af42-4d2e-a905-03134a47bda9 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:08.213857 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb10c30-af42-4d2e-a905-03134a47bda9 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:08.213959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb10c30-af42-4d2e-a905-03134a47bda9 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:08.216146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 413/822] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:08.222728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:08.223761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:08.223964 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:08.244252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:08.245767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:08.338966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 410/823] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:08.364754 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb10c30-af42-4d2e-a905-03134a47bda9 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:08.467662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb10c30-af42-4d2e-a905-03134a47bda9 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:08.504958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:08.505826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:08.506106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:08.506379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:08.516949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:08.518485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:08.539341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:08.540570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:08.542058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:08.542058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:08.542058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:08.542058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:08.542058 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 414/824] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:08.546909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:08.656412 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57395-e1a1-441c-90b3-93aab232797d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:08.698029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:08.698699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:08.698984 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:08.699262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:08.700016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:08.700360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:08.702070 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60063-4ef0-49db-baa1-7fba1f7443de None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:08.721300 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 411/825] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:08.722512 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:08.845936 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb254a-2a49-40b0-bea5-61cedc944ab8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:08.882517 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:08.883305 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:08.883648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:08.883885 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:08.884582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:08.885992 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b4872-b457-461e-a778-ef5857d02965 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:08.907152 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 415/826] 10.222.0.58 () {60 vars in 1132 bytes} [Wed May 11 16:52:08 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:52:11.304995 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84b77-dfde-464d-8f2b-d8ea06ecdfe0 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:11.305553 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84b77-dfde-464d-8f2b-d8ea06ecdfe0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:11.305553 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84b77-dfde-464d-8f2b-d8ea06ecdfe0 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:11.307123 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 412/827] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:11.312621 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:11.313099 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:11.313202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:11.329435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:11.330615 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:11.403799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 416/828] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:11.428924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84b77-dfde-464d-8f2b-d8ea06ecdfe0 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:11.537354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84b77-dfde-464d-8f2b-d8ea06ecdfe0 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:11.572233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:11.572947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:11.573232 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:11.573514 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:11.584902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:11.593534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:11.594632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:11.595738 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 413/829] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:11.601680 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:11.705509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4944-f503-428c-85b6-62be89a2ba14 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:11.743777 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:11.744528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:11.744808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:11.745079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:11.745843 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:11.746164 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:11.747743 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:11.756685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 417/830] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:11.762819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:11.874776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739649ca-d454-4941-acdf-3d58013e876c None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:11.907967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712c522-3328-4381-9606-040a5635f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:11.908818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712c522-3328-4381-9606-040a5635f0be None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:11.909101 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712c522-3328-4381-9606-040a5635f0be None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:11.909376 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712c522-3328-4381-9606-040a5635f0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:11.919669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712c522-3328-4381-9606-040a5635f0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:11.921107 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712c522-3328-4381-9606-040a5635f0be None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-e712c522-3328-4381-9606-040a5635f0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:11.938241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:11.939762 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:11.944333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:11.944333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:11.944333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:11.944333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:11.944333 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 414/831] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:11.945623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:12.048857 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eef168-40b9-48c7-8bf0-4355605faeb8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:12.087318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:12.088005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:12.088289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:12.088570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:12.089281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:12.089592 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:12.090961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:12.102644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 418/832] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:12.108274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712c522-3328-4381-9606-040a5635f0be None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:12.215368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712c522-3328-4381-9606-040a5635f0be None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:12.249015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:12.249900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:12.250189 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:12.250469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:12.260349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:12.262177 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:12.276992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:12.277986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:12.278930 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 415/833] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:12.283975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:12.383027 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921642d7-bf21-4b33-b3e4-ab08ecb65323 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:12.418635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:12.419298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:12.419605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:12.419914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:12.420704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:12.421013 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:12.422431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:12.440158 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 419/834] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:52:12.445857 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:12.551690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaea3d-73f4-4b1a-b5e3-a47b4e9037e0 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:12.586703 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:12.587632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:12.587915 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:12.588192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:12.654714 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:12.656230 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:12.772082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 416/835] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:52:12 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:52:12.777771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:12.881393 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697158d2-6250-41fc-bddc-9410ac2b69c1 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:12.915824 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:12.916685 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:12.916973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:12.917281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:12.928098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:12.929549 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:12.947524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:12.948500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:12.949386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:12.949386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:12.949386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:12.949386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:12.949386 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 420/836] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:12.954529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:13.058621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c651d67-3fc4-4cde-a121-0ed8ada0f0b9 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:13.097541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:13.098469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:13.098816 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:13.099145 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:13.099957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:13.100386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:13.101875 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:13.115406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 417/837] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:13.121140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:13.244160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922ad7-017b-4723-8043-6d1ce7d2e569 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:13.282502 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:13.283375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:13.283634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:13.283973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:13.293286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:13.294954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:13.309815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:13.310792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:13.311852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 421/838] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:13.317237 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:13.428569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb496a9-5f75-41fc-885d-937d16674dbf None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:13.462212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:13.462879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:13.463162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:13.463464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:13.464258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:13.464558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:13.465996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f211e9f-761a-4a2f-bc9a-5008f4394586 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:13.479318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 418/839] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:13.485513 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:13.592183 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ede6-d988-4702-95c8-5894872bf032 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:13.625826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:13.626483 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:13.626769 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:13.627048 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:13.628007 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=02582a7f42294aa883540235c867979a) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:13.628312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:13.629770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab672b40-e803-4ca9-9615-d10d599f9de1 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:13.636299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 422/840] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:52:13 2022] GET /identity/v3/role_assignments?user.id=02582a7f42294aa883540235c867979a&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:15.909098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b33da-ab1a-4121-acc8-aa963f1b9f61 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:15.909676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b33da-ab1a-4121-acc8-aa963f1b9f61 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:15.909676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b33da-ab1a-4121-acc8-aa963f1b9f61 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:15.911139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 419/841] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:15.916464 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:15.917020 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:15.917020 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:15.935680 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:15.936866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:16.007646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 423/842] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:16.034562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b33da-ab1a-4121-acc8-aa963f1b9f61 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:16.142796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b33da-ab1a-4121-acc8-aa963f1b9f61 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:16.179188 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:16.179937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:16.180216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:16.180483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:16.191091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:16.199743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:16.200898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:16.201868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 420/843] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:16.207440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:16.313167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb1965-976f-4559-a553-fa8d7e0b79e4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:16.348657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:16.349330 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:16.349619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:16.349953 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:16.351033 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:16.351367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:16.352877 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:16.361581 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 424/844] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:16.368814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:16.476602 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faebe-002c-4dcb-a8be-44296f45ad70 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:16.512256 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573eb3-a374-4898-908e-def962109147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:16.513110 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573eb3-a374-4898-908e-def962109147 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:16.513395 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573eb3-a374-4898-908e-def962109147 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:16.513674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573eb3-a374-4898-908e-def962109147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:16.525058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573eb3-a374-4898-908e-def962109147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:16.526505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573eb3-a374-4898-908e-def962109147 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-12573eb3-a374-4898-908e-def962109147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:16.543942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:16.545051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:16.546152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:16.546152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:16.546152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:16.546152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:16.546152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 421/845] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:16.551176 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:16.661858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85882484-826d-418c-ad9d-b7e2cbd08ea9 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:16.699062 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:16.699750 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:16.700031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:16.700305 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:16.701016 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:16.701320 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:16.702690 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:16.717501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 425/846] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:16.723688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573eb3-a374-4898-908e-def962109147 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:16.824813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573eb3-a374-4898-908e-def962109147 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:16.865597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:16.866507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:16.866795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:16.867100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:16.876190 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:16.878186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:16.894541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:16.896460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:16.897713 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:16.898712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 422/847] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:16.905091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.012747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fab5-3953-4ad0-b272-519d3235615d None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.047527 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.048191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.048471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.048748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.049775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:17.050086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.051695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.069747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 426/848] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:17.075677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.186883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7a9c1-5fef-4a05-8215-efd67e07dd2a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.223920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.224727 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.225021 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.225286 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.235628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.237064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:17.254193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:17.255787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:17.257135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:17.257135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:17.257135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:17.257135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:17.257135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 423/849] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:17.262982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.369321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6facc0-bddd-456e-941e-1349f54e077c None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.405887 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.406546 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.406831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.407191 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.408025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:17.408337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.410009 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.428740 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 427/850] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:17.429956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.536702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f80ad-83ed-41ce-b179-c403fad0e69e None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.572681 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.573484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.573765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.574043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.580747 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.582996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:17.597252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:17.598912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:17.604650 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 424/851] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:17.605244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.711660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600263cc-e9bf-48c0-8004-61846dcb0369 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.745079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.745846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.746227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.746550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.747453 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:17.747765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.749241 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85206-21e0-4b39-bc58-75ff34c431e9 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.762349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 428/852] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:17.768334 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:17.874798 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf251eeb-19b2-40c3-8b76-d0a7fcfb3e53 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:17.909666 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:17.910575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:17.910859 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:17.911142 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/02582a7f42294aa883540235c867979a/roles/e1e2d4a790984f15a5beea7979ffd19d` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:17.928491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=02582a7f42294aa883540235c867979a, role_id=e1e2d4a790984f15a5beea7979ffd19d)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:17.930035 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aac969-4f28-4e55-8460-a8d619035f89 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:17.945537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 425/853] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:52:17 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/02582a7f42294aa883540235c867979a/roles/e1e2d4a790984f15a5beea7979ffd19d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 16:52:20.493197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f996a-535d-49f2-9fc4-44003e79609f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:20.493796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f996a-535d-49f2-9fc4-44003e79609f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:20.493796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f996a-535d-49f2-9fc4-44003e79609f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:20.495088 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 429/854] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:20.501137 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:20.501669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:20.501941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:20.522716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:20.523923 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:20.596439 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 426/855] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:20.623625 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f996a-535d-49f2-9fc4-44003e79609f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:20.740242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f996a-535d-49f2-9fc4-44003e79609f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:20.784823 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:20.786174 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:20.786403 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:20.786704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:20.797755 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:20.813447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:20.814701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:20.815582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 430/856] 10.222.0.58 () {56 vars in 1102 bytes} [Wed May 11 16:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:20.821572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:20.930600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1af9b-ee1f-428f-9e51-18ddb9dfca3b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:20.964313 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:20.964971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:20.965257 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:20.965536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:20.966278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] RBAC: Adding query filter params (name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:20.966582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:20.968031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:20.976804 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 427/857] 10.222.0.58 () {56 vars in 1103 bytes} [Wed May 11 16:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:20.982238 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:21.088197 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d426-8c08-49d0-b849-29cb2ecb1c4e None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:21.125977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:21.126775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:21.127055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:21.127335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:21.138562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:21.140096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:21.163890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:21.165299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:21.166728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:21.166728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:21.166728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:21.166728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:21.166728 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 431/858] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:21.171416 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:21.294728 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26f6b-e647-48c2-81f6-6ec463daee0a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:21.334845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:21.335810 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:21.336181 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:21.336579 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:21.337679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:21.338170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:21.340070 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:21.352924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 428/859] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:21.358647 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:21.472207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941301da-4559-42da-b3e0-83fb03918286 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:21.508578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:21.509367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:21.509648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:21.509918 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:21.518331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:21.520340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:21.534424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:21.535632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:21.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 432/860] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:21.541453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:21.642834 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc93e4-07db-42a4-b239-b85f340ddb24 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:21.676642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:21.677378 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:21.677720 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:21.677947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:21.678883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:21.679209 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:21.680769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:21.698814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 429/861] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:21.704748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:21.808569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76285453-d303-4f34-bbfb-7ec45e0555b3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:21.843248 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:21.843917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:21.844198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:21.844473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:21.912623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:21.914002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.014818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 433/862] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:52:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:52:22.020782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:22.121882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff61ee-bdc7-4820-b3af-67c9b2a010d5 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:22.158776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:22.160176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:22.161039 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:22.161318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:22.174254 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:22.176856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:22.196233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:22.197646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:22.198992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:22.198992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:22.198992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:22.198992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:22.198992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 430/863] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:22.203884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:22.322281 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ceca-e747-4379-94f1-9c0a5c595455 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:22.362149 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:22.363383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:22.364497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:22.365077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:22.366512 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:22.367089 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:22.369533 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.386895 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 434/864] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:22.394704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:22.508115 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e58f18-eec0-4d6f-9afa-5460cf2ec85a None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:22.543663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:22.544480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:22.544773 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:22.545019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:22.551675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:22.553103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:22.567126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:22.573174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:22.574361 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 431/865] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:22.574961 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:22.675957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bce09-9731-40ac-992e-1fdb90b5c3b3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:22.711290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:22.711971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:22.712266 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:22.712520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:22.713341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:22.713598 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:22.715009 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade09f91-ab26-4faf-bd5d-4331851dcaa8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.727273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 435/866] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:22.734017 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:22.844803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080148a3-9992-41ba-a964-f4aa21682f1d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:22.882507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:22.883193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:22.883501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:22.883776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:22.884608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] RBAC: Adding query filter params (role.id=e1e2d4a790984f15a5beea7979ffd19d, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=02582a7f42294aa883540235c867979a) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:22.885014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:22.886384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704be8d-51c3-40b6-a4ed-a764c3fb5305 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:22.892417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 432/867] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:52:22 2022] GET /identity/v3/role_assignments?user.id=02582a7f42294aa883540235c867979a&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=e1e2d4a790984f15a5beea7979ffd19d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:25.506832 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08727ff-9a52-474b-9c67-344b04cacaad None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:25.507374 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08727ff-9a52-474b-9c67-344b04cacaad None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:25.507469 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08727ff-9a52-474b-9c67-344b04cacaad None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:25.508772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 436/868] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:52:25.514196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:25.514663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:25.514769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:25.531212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:25.532559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:25.598267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 433/869] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:25.622571 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08727ff-9a52-474b-9c67-344b04cacaad None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:25.728136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08727ff-9a52-474b-9c67-344b04cacaad None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:25.765420 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:25.766227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:25.766509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:25.766782 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:25.778532 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:25.786473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:25.787594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:25.788430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 437/870] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:25.793922 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:25.894510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb0d03-61e4-4a32-ac3e-abe1c60a1bc5 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:25.929571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:25.930252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:25.930540 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:25.930815 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:25.931605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:25.931914 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:25.933315 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:25.942197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 434/871] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:52:25.947998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.047244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ae2a-dd36-4298-8c98-4f0ed3a23cc5 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:26.080846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:26.081884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:26.082209 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:26.082480 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:26.092906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:26.094347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:26.111325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:26.112451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:26.114316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:26.114316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:26.114316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:26.114316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:26.114316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 438/872] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:26.118799 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.227766 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629ecf-50e8-41b1-8aa2-2c5ec404a4ea None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:26.260675 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:26.261341 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:26.261623 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:26.261904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:26.262677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:26.262924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:26.264323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:26.276366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 435/873] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:26.282025 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.381019 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25ee86-6e98-4baa-a593-f6c653d45388 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:26.412570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:26.413357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:26.413634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:26.413907 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:26.420915 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:26.422334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:26.436144 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:26.437224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:26.438388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 439/874] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:26.442944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.537091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e093c4-27c2-4b30-9bcd-fd96185a45d6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:26.567545 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:26.568200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:26.568477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:26.568745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:26.569551 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:26.569855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:26.571261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:26.587779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 436/875] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:26.593416 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.686229 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3be91-c749-4839-ad3c-f0139789db14 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:26.718257 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:26.718882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:26.719164 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:26.719468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:26.781089 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:26.782512 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:26.873520 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 440/876] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:52:26 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:52:26.879693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:26.970723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d061-e8ef-40c4-8eaf-411ac5a481bd None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:27.001442 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:27.002207 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:27.002484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:27.002754 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:27.012604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:27.014059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:27.030476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:27.031326 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:27.032244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:27.032244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:27.032244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:27.032244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:27.032244 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 437/877] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:27.037082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:27.130403 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf977b-508f-4662-9454-2168931ee892 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:27.164558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:27.165367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:27.165853 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:27.166158 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:27.166982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:27.167328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:27.169178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:27.181411 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 441/878] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:27.187205 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:27.284369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e78e4b-8891-4658-b2f5-a9cd4ce856a0 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:27.316988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:27.317765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:27.318043 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:27.318310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:27.324694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:27.326120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:27.339546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:27.340557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:27.341504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 438/879] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:27.346451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:27.438844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188869-3c1b-4edb-ac5a-b6ee8707f4f3 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:27.469259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:27.469906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:27.470186 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:27.470460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:27.471229 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:27.471564 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:27.473471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff8299-1f1b-4a1d-b5db-a77edf4e9a66 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:27.484920 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 442/880] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:27.491501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:27.582815 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef47e5c-2fc2-40a7-a112-2a7c6404d1ce None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:27.614014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:27.614643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:27.614924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:27.615193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:27.616038 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=02582a7f42294aa883540235c867979a) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:27.616347 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:27.617755 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e151d-cbcc-431b-b5cb-f905dce27591 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:27.623023 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 439/881] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:52:27 2022] GET /identity/v3/role_assignments?user.id=02582a7f42294aa883540235c867979a&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=df86ea59d76740488f867f6211ccfa28 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:29.874112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5ae4-0ba7-4915-8f39-cece6c1ebc8c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:29.874623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5ae4-0ba7-4915-8f39-cece6c1ebc8c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:29.874623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5ae4-0ba7-4915-8f39-cece6c1ebc8c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:29.875959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 443/882] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:29.881688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:29.882106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:29.882359 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:29.899066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:29.900269 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:29.962086 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 440/883] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:29.985211 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5ae4-0ba7-4915-8f39-cece6c1ebc8c None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.079901 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5ae4-0ba7-4915-8f39-cece6c1ebc8c None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.110799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.111591 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.111876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.112150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.122112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:30.130275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:30.131370 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:30.132391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 444/884] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:30.137543 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.245360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca045-4488-456f-911d-46d2fcbdebe1 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.277501 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.278159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.278443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.278722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.279495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:30.279804 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:30.281170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:30.289144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 441/885] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:30.294912 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.388573 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281869ca-3883-4226-bff2-e71cdca99801 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.419771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.420546 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.420827 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.421106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.431778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:30.433205 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:30.449529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:30.450605 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:30.451852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:30.451852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:30.451852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:30.451852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:30.451852 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 445/886] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:30.456500 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.554669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d7b7-401f-4767-bdc0-5c40ec996961 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.584919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.585562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.585840 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.586113 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.586812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:30.587112 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:30.588499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:30.599864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 442/887] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:30.605445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.699103 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab57c99-dd06-493b-9829-a67def7f7369 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.730456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.731230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.731541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.731817 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.740220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:30.741634 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:30.755323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:30.756455 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:30.757461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 446/888] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:30.762054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:30.865134 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f8a9f-11f9-4122-bc01-62b3c9ba2d68 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:30.898221 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:30.898880 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:30.899164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:30.899470 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:30.900293 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:30.900603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:30.902014 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:30.918418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 443/889] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:30.924074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:31.016113 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262201-39b4-401d-8400-c386d10b1e63 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:31.047356 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:31.048138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:31.048415 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:31.048683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:31.059066 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:31.060515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:31.077154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:31.078178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:31.079086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:31.079086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:31.079086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:31.079086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:31.079086 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 447/890] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:31.083954 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:31.182965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0138f6-3871-4a60-8b62-4272b98b7ba6 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:31.214036 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:31.214677 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:31.214956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:31.215229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:31.215969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:31.216270 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:31.217619 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:31.228832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 444/891] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:31.234490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:31.331230 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abaeb-e9b5-4448-a39f-4cad8d24e6a8 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:31.362258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:31.363026 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:31.363896 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:31.364171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:31.370382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:31.371830 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:31.385331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:31.386334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:31.387444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 448/892] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:31.392245 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:31.485587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e77d8-2afc-4fc5-9a9c-f6e9ec08719b None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:31.517781 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:31.518415 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:31.518695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:31.518963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:31.520243 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:31.520545 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:31.521938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429950b2-3f82-4c8d-810a-9ac0132b9954 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:31.532550 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 445/893] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:31.538914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:31.630147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14562c6-58b7-44b6-91a1-7a5edea698fb None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:31.662270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:31.663128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:31.663441 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:31.663727 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] PATH_INFO: `/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/02582a7f42294aa883540235c867979a/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:31.665635 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cce53653c2c47039a2111ec785ab54d, user_id=02582a7f42294aa883540235c867979a, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:31.667046 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe3e07-3f91-4a78-b07e-4ba728d5dc99 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:31.679306 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 449/894] 10.222.0.58 () {58 vars in 1439 bytes} [Wed May 11 16:52:31 2022] PUT /identity/v3/projects/6cce53653c2c47039a2111ec785ab54d/users/02582a7f42294aa883540235c867979a/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:52:33.923215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c21d-24ed-4bb7-bd4a-09527b311328 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:33.923763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c21d-24ed-4bb7-bd4a-09527b311328 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:33.923763 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c21d-24ed-4bb7-bd4a-09527b311328 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:33.925082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 446/895] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:33.930758 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:33.931222 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:33.931310 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:33.947990 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:33.949146 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:34.010389 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 450/896] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:34.034301 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c21d-24ed-4bb7-bd4a-09527b311328 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.128312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c21d-24ed-4bb7-bd4a-09527b311328 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.163667 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.164539 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.164849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.165127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.177040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 16:52:34.184928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:34.185939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:34.187147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 447/897] 10.222.0.58 () {56 vars in 1096 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:34.192721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.291384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07401778-d0b9-40b6-9fdc-44a1234dcf4d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.323731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.324377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.324654 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.324924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.325649 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:34.325947 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:34.327298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:34.335053 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 451/898] 10.222.0.58 () {56 vars in 1099 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:34.340740 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.436069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd0fe-943e-4e93-b7b8-ec6484b8cbe1 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.467525 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.468296 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.468575 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.468847 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.478981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:34.480472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:34.497311 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:34.498354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:34.499477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:34.499477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:34.499477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:34.499477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:34.499477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 448/899] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:34.504818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.597575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ee8-1ccc-4000-8955-e216761af870 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.628479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.629684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.629966 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.630243 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.630949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:34.631257 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:34.632640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:34.643615 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 452/900] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:34.648936 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.741811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efccaa-cc78-41d7-8e5f-2bb32febc276 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.772372 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.773140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.773428 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.773704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.780579 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:34.781995 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 16:52:34.796196 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:34.797249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:34.798384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 449/901] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:34.803036 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:34.902928 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a801-3340-4f84-ab4b-9dda724d2f83 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:34.935171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:34.935861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:34.936152 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:34.936429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:34.937252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:34.937560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:34.938970 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:34.955409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 453/902] 10.222.0.58 () {56 vars in 1143 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:34.962119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.054832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b3e8-d134-4a9d-a6af-def6f4e7f9fb None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.086555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.087183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.087502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.087782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.154023 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.155537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.247534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 450/903] 10.222.0.58 () {58 vars in 1282 bytes} [Wed May 11 16:52:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 16:52:35.253245 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.347125 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892479-8556-40fa-9c23-d7961f225823 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.379449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.380227 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.380509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.380785 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.390198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.391664 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 16:52:35.408383 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:35.409476 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:35.410768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 16:52:35.410768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 16:52:35.410768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 16:52:35.410768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:35.410768 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 454/904] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:35.415264 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.509116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cdad9-49c5-4953-a4d5-8d288c77075d None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.539939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.540587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.540875 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.541154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.541863 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:35.542168 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.543549 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.554492 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 451/905] 10.222.0.58 () {56 vars in 1109 bytes} [Wed May 11 16:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:35.560095 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.652388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aceca-b2a7-4706-9121-3feb8a1ed862 None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.684389 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.685148 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.685425 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.685697 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.691987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.693395 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 16:52:35.706795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application with Lock( May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:35.707858 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: ERROR keystone.server.flask.application May 11 16:52:35.708916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 455/906] 10.222.0.58 () {56 vars in 1111 bytes} [Wed May 11 16:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:35.713431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.805966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff698-5f45-41b8-83ee-d7ab37fcf24f None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.836436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.837069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.837350 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.837622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.838386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:35.838691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.840127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec948ba-8ff7-4abb-ba01-0607fa76db96 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.851721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 452/907] 10.222.0.58 () {56 vars in 1148 bytes} [Wed May 11 16:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:52:35.857593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:35.951632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf7159-e4fb-4e02-94c5-87c311241ffa None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:35.982843 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:35.983503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:35.983793 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:35.984075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:35.984889 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] RBAC: Adding query filter params (role.id=df86ea59d76740488f867f6211ccfa28, scope.project.id=6cce53653c2c47039a2111ec785ab54d, user.id=02582a7f42294aa883540235c867979a) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:35.985202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:35.986603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7b7d-7b8f-43ca-8b81-8a2de996cfa2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:35.992756 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 456/908] 10.222.0.58 () {56 vars in 1374 bytes} [Wed May 11 16:52:35 2022] GET /identity/v3/role_assignments?user.id=02582a7f42294aa883540235c867979a&scope.project.id=6cce53653c2c47039a2111ec785ab54d&role.id=df86ea59d76740488f867f6211ccfa28 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:38.241051 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e586-017e-4d32-9348-f0edfe174fb3 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:38.241635 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e586-017e-4d32-9348-f0edfe174fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:38.241635 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e586-017e-4d32-9348-f0edfe174fb3 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:38.242940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 453/909] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:38.248038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:38.248460 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:38.248589 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:38.265167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:38.266316 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:38.327916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 457/910] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:38.350796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e586-017e-4d32-9348-f0edfe174fb3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:38.445916 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e586-017e-4d32-9348-f0edfe174fb3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:38.477303 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:38.478088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:38.478373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:38.478644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:38.479279 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:38.480656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:38.492627 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:38.494571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:38.496454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 454/911] 10.222.0.58 () {56 vars in 1117 bytes} [Wed May 11 16:52:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:38.499879 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:38.590317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794519-f82c-48bc-aa7e-6b08f000f3b7 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:38.621299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:38.621939 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:38.622214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:38.622483 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:38.623166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:38.623497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:38.624839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13e7fb-5f15-4052-aae8-f7b23cccb470 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:38.629889 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 458/912] 10.222.0.58 () {56 vars in 1116 bytes} [Wed May 11 16:52:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 16:52:38.635510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:38.727526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b7b4-9a0c-4ab8-85ba-73f4eaa47287 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:38.758200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:38.758781 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:38.759069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:38.759336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] PATH_INFO: `/v3/services` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:38.760053 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:38.760351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:38.761701 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64adff-7b9d-4559-93e9-9d457c2004ab None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:38.765938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 455/913] 10.222.0.58 () {56 vars in 1116 bytes} [Wed May 11 16:52:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:41.007861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd613c-e230-43c2-a480-d2f6eba0e38f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:41.008382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd613c-e230-43c2-a480-d2f6eba0e38f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:41.008472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd613c-e230-43c2-a480-d2f6eba0e38f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:41.009778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 459/914] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:41.014745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e0a1-2e81-482f-8bb5-e3d2224bb4b4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:41.015124 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e0a1-2e81-482f-8bb5-e3d2224bb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:41.015297 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e0a1-2e81-482f-8bb5-e3d2224bb4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:41.032794 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-2949e0a1-2e81-482f-8bb5-e3d2224bb4b4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:41.033939 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-2949e0a1-2e81-482f-8bb5-e3d2224bb4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:41.094879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 456/915] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:41.117559 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd613c-e230-43c2-a480-d2f6eba0e38f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:41.215838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd613c-e230-43c2-a480-d2f6eba0e38f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:41.248265 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:41.248907 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:41.249185 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:41.249459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:41.250171 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:41.251541 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832d47-d4c3-47ec-a42a-5c46993b844e None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:41.265848 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 460/916] 10.222.0.58 () {60 vars in 1141 bytes} [Wed May 11 16:52:41 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:52:43.504069 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad251e41-c31d-4ac6-9249-df21648ef6f9 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:43.504598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad251e41-c31d-4ac6-9249-df21648ef6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:43.504598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad251e41-c31d-4ac6-9249-df21648ef6f9 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:43.505978 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 457/917] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:43.511044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:43.511495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:43.511616 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:43.527683 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:43.528839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:43.595653 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 461/918] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:43 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:43.619021 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad251e41-c31d-4ac6-9249-df21648ef6f9 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:43.712431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad251e41-c31d-4ac6-9249-df21648ef6f9 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:43.743409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:43.744139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:43.744418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:43.744694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:43.745330 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:43.746687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:43.758749 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:43.759912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:43.760968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 458/919] 10.222.0.58 () {56 vars in 1117 bytes} [Wed May 11 16:52:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:43.765849 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:43.865990 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3d9e-664a-446b-8fd5-3d193a41dbc8 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:43.897435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:43.898076 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:43.898354 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:43.898623 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:43.899307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:43.899640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:43.900984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:43.905703 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 462/920] 10.222.0.58 () {56 vars in 1116 bytes} [Wed May 11 16:52:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:43.912169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:44.004517 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc293aa-dd75-4435-b52a-a057fd0adc56 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:44.035525 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:44.036157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:44.036440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:44.036716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:44.037485 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] RBAC: Adding query filter params (interface=public, service_id=cf94b355dfa84b6dab94e4a03e7b23e1, region_id=RegionOne) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:44.037792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:44.039144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698d46-c27b-496d-af8e-ca95354131e0 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:44.043935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 459/921] 10.222.0.58 () {56 vars in 1251 bytes} [Wed May 11 16:52:43 2022] GET /identity/v3/endpoints?service_id=cf94b355dfa84b6dab94e4a03e7b23e1&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:44.049356 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:44.142413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10bf58-9824-444a-b612-1a18bb0c376b None admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:44.176098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:44.176747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:44.177024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:44.177290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:44.177955 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:44.179300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692c15a-0cee-4ba7-a10e-1784ef5b5962 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:44.185500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 463/922] 10.222.0.58 () {56 vars in 1087 bytes} [Wed May 11 16:52:44 2022] GET /identity/v3/services => generated 1962 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:52:46.427216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc7f9-f194-4c48-88dd-c52ca10f7857 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:46.427801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc7f9-f194-4c48-88dd-c52ca10f7857 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:46.427801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc7f9-f194-4c48-88dd-c52ca10f7857 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:46.429164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 460/923] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:52:46.434168 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:46.434529 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:46.434722 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:46.450607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:52:46.451792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:52:46.513803 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 464/924] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:52:46 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 16:52:46.540066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc7f9-f194-4c48-88dd-c52ca10f7857 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:46.636090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc7f9-f194-4c48-88dd-c52ca10f7857 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:46.667769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:46.668544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:46.668844 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:46.669115 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:46.669748 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:46.671086 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 16:52:46.682469 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 16:52:46.683679 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.get_or_create( May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application with Lock( May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self._enter() May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application return self.creator() May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application created_value = creator( May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: ERROR keystone.server.flask.application May 11 16:52:46.684502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 461/925] 10.222.0.58 () {56 vars in 1117 bytes} [Wed May 11 16:52:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 16:52:46.689595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:46.779631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd12430-47db-4ce0-8663-5f9145a7edb6 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:46.810522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:46.811160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:46.811466 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:46.811737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] PATH_INFO: `/v3/services` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:46.812424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:52:46.812725 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:46.814068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a4b8-e982-4a31-838b-7d7c46997bb2 None admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:46.818764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 465/926] 10.222.0.58 () {56 vars in 1116 bytes} [Wed May 11 16:52:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:52:46.824219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:52:46.917139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f8384-9b2b-4393-b21e-1bc6ec7ec821 None admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:52:46.948119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:52:46.948693 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:52:46.948973 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:52:46.949245 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:52:46.949975 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:52:46.951324 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7ff4-59fa-467e-b0fe-e9052d68a87b None admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:52:46.969025 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 462/927] 10.222.0.58 () {60 vars in 1144 bytes} [Wed May 11 16:52:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:53:45.104866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710310c-f4ad-4446-8637-8e381136ee23 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:45.105414 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710310c-f4ad-4446-8637-8e381136ee23 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:45.105414 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710310c-f4ad-4446-8637-8e381136ee23 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:45.107256 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 466/928] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:45.115440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dbb5f-fafe-4d4c-95e9-5a94dc3ae5cf None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:45.116323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dbb5f-fafe-4d4c-95e9-5a94dc3ae5cf None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:45.116799 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dbb5f-fafe-4d4c-95e9-5a94dc3ae5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:45.138456 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-b18dbb5f-fafe-4d4c-95e9-5a94dc3ae5cf None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:45.139803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-b18dbb5f-fafe-4d4c-95e9-5a94dc3ae5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:45.219708 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 463/929] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:45.301812 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096d41-effb-4caf-9392-96bd2b4f8c4b None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:45.302200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096d41-effb-4caf-9392-96bd2b4f8c4b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:45.302551 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096d41-effb-4caf-9392-96bd2b4f8c4b None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:45.304079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 467/930] 10.222.0.58 () {54 vars in 964 bytes} [Wed May 11 16:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:45.310967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e3a-c805-4489-9654-a1d8617aa6c6 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:45.311499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e3a-c805-4489-9654-a1d8617aa6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:45.311850 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e3a-c805-4489-9654-a1d8617aa6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:45.390539 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-3ec57e3a-c805-4489-9654-a1d8617aa6c6 None None] MFA Rules not processed for user `5f1f023aee544e4fa1c31808f7b3ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:45.393686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-3ec57e3a-c805-4489-9654-a1d8617aa6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:45.477737 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 464/931] 10.222.0.58 () {58 vars in 1061 bytes} [Wed May 11 16:53:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:45.478475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a096d41-effb-4caf-9392-96bd2b4f8c4b None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:45.489960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a096d41-effb-4caf-9392-96bd2b4f8c4b None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:45.493507 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:45.494175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:45.494490 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:45.494671 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:45.509470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:45.510898 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fec2a-7a4b-42ee-85f5-a01730d5fcdd service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:45.522096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 468/932] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 16:53:48.107953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889522d-d582-44c0-aeda-31f79107a31d None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:48.108587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889522d-d582-44c0-aeda-31f79107a31d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:48.108587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889522d-d582-44c0-aeda-31f79107a31d None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:48.109870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 465/933] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:48.115749 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c0c7c-e9e9-411b-b4e2-5a34ba75aa98 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:48.116192 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c0c7c-e9e9-411b-b4e2-5a34ba75aa98 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:48.116288 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c0c7c-e9e9-411b-b4e2-5a34ba75aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:48.134244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-643c0c7c-e9e9-411b-b4e2-5a34ba75aa98 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:48.135439 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-643c0c7c-e9e9-411b-b4e2-5a34ba75aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:48.143208 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 469/934] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:48.181535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889522d-d582-44c0-aeda-31f79107a31d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:48.192622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889522d-d582-44c0-aeda-31f79107a31d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:48.196024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:48.196662 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:48.196941 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:48.197214 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:48.205986 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:48.207704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414f97-5a33-4985-a5de-5c262df1225c service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:48.217199 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 466/935] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:53:50.847962 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967777-cc66-44fe-af11-a404d78d98f3 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:50.848462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967777-cc66-44fe-af11-a404d78d98f3 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:50.848462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967777-cc66-44fe-af11-a404d78d98f3 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:50.849776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 470/936] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:50.855110 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a0ef-6dcf-43d5-a920-9b560f540d25 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:50.855696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a0ef-6dcf-43d5-a920-9b560f540d25 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:50.855801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a0ef-6dcf-43d5-a920-9b560f540d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:50.894865 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-e951a0ef-6dcf-43d5-a920-9b560f540d25 None None] MFA Rules not processed for user `cc583517d7df4bf0b962b0fa96035dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:50.896325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-e951a0ef-6dcf-43d5-a920-9b560f540d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:50.960691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 467/937] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:50 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:51.000759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967777-cc66-44fe-af11-a404d78d98f3 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:51.011795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967777-cc66-44fe-af11-a404d78d98f3 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:51.015334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:51.015994 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:51.016273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:51.016544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:51.025156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:51.026544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aadfd2-67d6-45a0-a0d3-e49474629642 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:51.035526 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 471/938] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:50 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:53:53.830745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970caa3-1a7d-4a02-8687-846c7428ed75 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:53.831267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970caa3-1a7d-4a02-8687-846c7428ed75 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:53.831267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970caa3-1a7d-4a02-8687-846c7428ed75 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:53.832870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 468/939] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:53.837982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c94c3-bad2-4b9f-963e-16852db44d37 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:53.838361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c94c3-bad2-4b9f-963e-16852db44d37 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:53.838518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c94c3-bad2-4b9f-963e-16852db44d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:53.855322 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-1e0c94c3-bad2-4b9f-963e-16852db44d37 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:53.856509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-1e0c94c3-bad2-4b9f-963e-16852db44d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:53.924650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 472/940] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:53 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:53.963484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970caa3-1a7d-4a02-8687-846c7428ed75 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:53.973573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970caa3-1a7d-4a02-8687-846c7428ed75 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:53.976987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:53.977611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:53.977893 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:53.978166 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:53.987134 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:53.988604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41db343-d2bb-4754-86a6-8a4c21a8dcd9 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:53.997674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 469/941] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:53 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:53:56.890174 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a82f-1ab1-4447-91b8-f616766dece5 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:56.890672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a82f-1ab1-4447-91b8-f616766dece5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:56.890672 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a82f-1ab1-4447-91b8-f616766dece5 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:56.892675 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 473/942] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:56.898040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcca23-8853-47be-a012-92595d8c2eae None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:56.898445 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcca23-8853-47be-a012-92595d8c2eae None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:56.898599 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcca23-8853-47be-a012-92595d8c2eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:56.915841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-5bdcca23-8853-47be-a012-92595d8c2eae None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:56.916998 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-5bdcca23-8853-47be-a012-92595d8c2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:56.924453 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 470/943] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:56.961094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a82f-1ab1-4447-91b8-f616766dece5 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:56.971165 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a82f-1ab1-4447-91b8-f616766dece5 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:56.974516 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:56.975162 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:56.975451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:56.975726 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:56.984189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:56.986143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29f864-d7dc-4c82-9885-b275bf4d8486 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:56.995133 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 474/944] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:53:59.311292 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff617a-1a6d-483c-958d-263893e57961 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:59.311897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff617a-1a6d-483c-958d-263893e57961 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:59.311897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff617a-1a6d-483c-958d-263893e57961 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:59.313238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 471/945] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:59.318886 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7659-92fb-4b9c-93b4-35eb114b407f None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:59.319297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7659-92fb-4b9c-93b4-35eb114b407f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:59.319534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7659-92fb-4b9c-93b4-35eb114b407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:59.336716 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-0c0d7659-92fb-4b9c-93b4-35eb114b407f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:59.337880 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-0c0d7659-92fb-4b9c-93b4-35eb114b407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:59.345594 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 475/946] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:53:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:53:59.395106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993305-f0ca-4748-ae0d-886ed83a9a3f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:59.395418 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993305-f0ca-4748-ae0d-886ed83a9a3f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:59.395704 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993305-f0ca-4748-ae0d-886ed83a9a3f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:59.397241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 472/947] 10.222.0.58 () {54 vars in 964 bytes} [Wed May 11 16:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:53:59.402842 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416103-50b3-41d1-9841-42ddd6df67d6 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:59.403125 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416103-50b3-41d1-9841-42ddd6df67d6 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:59.403439 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416103-50b3-41d1-9841-42ddd6df67d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:59.420970 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4a416103-50b3-41d1-9841-42ddd6df67d6 None None] MFA Rules not processed for user `5f1f023aee544e4fa1c31808f7b3ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:53:59.422132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4a416103-50b3-41d1-9841-42ddd6df67d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:53:59.429002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 476/948] 10.222.0.58 () {58 vars in 1061 bytes} [Wed May 11 16:53:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:53:59.437833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993305-f0ca-4748-ae0d-886ed83a9a3f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:53:59.448687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993305-f0ca-4748-ae0d-886ed83a9a3f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:53:59.452102 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:53:59.452732 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:53:59.453012 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:53:59.453284 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:53:59.462697 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:53:59.463513 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f65a9-0d3e-4d69-901c-8232786e6942 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:53:59.473015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 473/949] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:53:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:01.991204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e023-912a-47c6-b577-5e8a5a9d1d2e None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:01.991796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e023-912a-47c6-b577-5e8a5a9d1d2e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:01.991796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e023-912a-47c6-b577-5e8a5a9d1d2e None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:01.993134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 477/950] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:01.998248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9114-afb5-4530-a673-9bd82cbd7fe3 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:01.998648 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9114-afb5-4530-a673-9bd82cbd7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:01.998936 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9114-afb5-4530-a673-9bd82cbd7fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:02.016384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-4c6b9114-afb5-4530-a673-9bd82cbd7fe3 None None] MFA Rules not processed for user `cc583517d7df4bf0b962b0fa96035dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:02.018120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-4c6b9114-afb5-4530-a673-9bd82cbd7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:02.025622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 474/951] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:01 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:02.063234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e023-912a-47c6-b577-5e8a5a9d1d2e None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:02.074314 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e023-912a-47c6-b577-5e8a5a9d1d2e None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:02.083696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:02.084786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:02.084786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:02.084973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:02.095011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:02.096515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ce3d3-8ed9-4773-9fdb-ae2f495f3ce5 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:02.105988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 478/952] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:02 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:04.801097 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b2e8-19ea-4b6c-bb4b-48bf12c5656e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:04.801612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b2e8-19ea-4b6c-bb4b-48bf12c5656e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:04.801612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b2e8-19ea-4b6c-bb4b-48bf12c5656e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:04.802909 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 475/953] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:04.808194 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9e1b-e106-4fc3-94cc-05ef0bb1081c None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:04.808644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9e1b-e106-4fc3-94cc-05ef0bb1081c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:04.808748 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9e1b-e106-4fc3-94cc-05ef0bb1081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:04.828038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-307f9e1b-e106-4fc3-94cc-05ef0bb1081c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:04.829307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-307f9e1b-e106-4fc3-94cc-05ef0bb1081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:04.837700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 479/954] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:04.875067 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197b2e8-19ea-4b6c-bb4b-48bf12c5656e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:04.885925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197b2e8-19ea-4b6c-bb4b-48bf12c5656e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:04.889336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:04.889966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:04.890248 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:04.890519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:04.899208 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:04.900658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151864d-6195-4d7a-afb7-2b9e5ae15568 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:04.910200 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 476/955] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:07.226149 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf9fb-331d-45f5-b390-a5ec044a80c2 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:07.226712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf9fb-331d-45f5-b390-a5ec044a80c2 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:07.226712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf9fb-331d-45f5-b390-a5ec044a80c2 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:07.228084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 480/956] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:07.233096 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da551-a182-462a-bd6c-c171c2075f7e None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:07.233497 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da551-a182-462a-bd6c-c171c2075f7e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:07.233646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da551-a182-462a-bd6c-c171c2075f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:07.251210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c69da551-a182-462a-bd6c-c171c2075f7e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:07.252404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c69da551-a182-462a-bd6c-c171c2075f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:07.259926 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 477/957] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:07.300219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf9fb-331d-45f5-b390-a5ec044a80c2 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:07.311833 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf9fb-331d-45f5-b390-a5ec044a80c2 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:07.315302 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:07.315977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:07.316257 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:07.316527 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:07.326421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:07.327934 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03978b3-0267-4c3f-92b4-a71ef06cf736 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:07.338353 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 481/958] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:10.094530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177e82-3e92-431d-832c-d86dfc87deb5 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:10.095068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177e82-3e92-431d-832c-d86dfc87deb5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:10.095162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177e82-3e92-431d-832c-d86dfc87deb5 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:10.096503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 478/959] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:10.101738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18849e9-5571-4eae-8562-a647f7463782 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:10.102155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18849e9-5571-4eae-8562-a647f7463782 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:10.102287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18849e9-5571-4eae-8562-a647f7463782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:10.119778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-b18849e9-5571-4eae-8562-a647f7463782 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:10.120933 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-b18849e9-5571-4eae-8562-a647f7463782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:10.129117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 482/960] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:10 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:10.165726 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89177e82-3e92-431d-832c-d86dfc87deb5 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:10.176545 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89177e82-3e92-431d-832c-d86dfc87deb5 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:10.179912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:10.180534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:10.180811 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:10.181079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:10.189434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:10.190842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1c6f-4004-4b25-8554-02ffc2819935 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:10.199745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 479/961] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:10 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:14.511458 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89508f1-5540-4700-b7b1-703c59a4f6de None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:14.511924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89508f1-5540-4700-b7b1-703c59a4f6de None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:14.511924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89508f1-5540-4700-b7b1-703c59a4f6de None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:14.513264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 483/962] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:14.518908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579293-4045-453b-8e64-7e81e43d1f3c None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:14.519321 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579293-4045-453b-8e64-7e81e43d1f3c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:14.519512 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579293-4045-453b-8e64-7e81e43d1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:14.542136 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-34579293-4045-453b-8e64-7e81e43d1f3c None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:14.543318 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-34579293-4045-453b-8e64-7e81e43d1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:14.551099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 480/963] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:14.591128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89508f1-5540-4700-b7b1-703c59a4f6de None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:14.602034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89508f1-5540-4700-b7b1-703c59a4f6de None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:14.605539 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:14.606252 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:14.606598 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:14.606937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:14.615657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:14.617049 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac63a-8c01-440a-8fa3-8bb1fcc9153d service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:14.626619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 484/964] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:17.538531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f077-7b53-4208-9c30-b1ddd5d6a3c6 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:17.539052 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f077-7b53-4208-9c30-b1ddd5d6a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:17.539170 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f077-7b53-4208-9c30-b1ddd5d6a3c6 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:17.540686 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 481/965] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:17.546805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b788-a027-42a7-baed-372310666e2a None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:17.547290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b788-a027-42a7-baed-372310666e2a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:17.547903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b788-a027-42a7-baed-372310666e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:17.566746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-22d5b788-a027-42a7-baed-372310666e2a None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:17.568031 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-22d5b788-a027-42a7-baed-372310666e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:17.578130 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 485/966] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:17 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:17.616159 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6f077-7b53-4208-9c30-b1ddd5d6a3c6 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:17.627116 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6f077-7b53-4208-9c30-b1ddd5d6a3c6 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:17.630543 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:17.631173 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:17.631644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:17.631920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:17.640639 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:17.642717 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9da53-a7a7-4c91-829b-4d768102b8ef service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:17.651919 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 482/967] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:17 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:22.209630 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387276ef-fe95-453e-b8d1-62e9436291da None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:22.210097 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387276ef-fe95-453e-b8d1-62e9436291da None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:22.210187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387276ef-fe95-453e-b8d1-62e9436291da None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:22.211578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 486/968] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:22.216953 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa49-8c65-4e5d-8c25-4ea1f5ae1ca8 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:22.217383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa49-8c65-4e5d-8c25-4ea1f5ae1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:22.217509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa49-8c65-4e5d-8c25-4ea1f5ae1ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:22.235646 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-dac9fa49-8c65-4e5d-8c25-4ea1f5ae1ca8 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:22.236827 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-dac9fa49-8c65-4e5d-8c25-4ea1f5ae1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:22.244746 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 483/969] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:54:22.283362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387276ef-fe95-453e-b8d1-62e9436291da None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:22.293746 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387276ef-fe95-453e-b8d1-62e9436291da None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:22.297194 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:22.297918 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:22.298254 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:22.299081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:22.307775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:22.309217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8097-1b5f-4cb2-9846-6ba248f73c67 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:22.318391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 487/970] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:27.731590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfe06-c830-4f28-a5fb-521e39c4d860 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:27.732526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfe06-c830-4f28-a5fb-521e39c4d860 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:27.733031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfe06-c830-4f28-a5fb-521e39c4d860 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:27.735466 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 484/971] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 16:54:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:27.740092 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1989-1060-4978-b84b-64372f6e1af5 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:27.740503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1989-1060-4978-b84b-64372f6e1af5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:27.740639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1989-1060-4978-b84b-64372f6e1af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:27.787486 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-099f1989-1060-4978-b84b-64372f6e1af5 None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:27.788861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-099f1989-1060-4978-b84b-64372f6e1af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:27.864702 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 488/972] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 16:54:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:32.198531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54be69-037a-4ae3-811b-7451874fb88e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:32.199090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54be69-037a-4ae3-811b-7451874fb88e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:32.199404 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54be69-037a-4ae3-811b-7451874fb88e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:32.200912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 485/973] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 16:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:32.207553 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578f57-aa94-4212-b7cd-61f1550b26aa None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:32.208479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578f57-aa94-4212-b7cd-61f1550b26aa None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:32.208831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578f57-aa94-4212-b7cd-61f1550b26aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:32.227676 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-85578f57-aa94-4212-b7cd-61f1550b26aa None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:32.228945 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-85578f57-aa94-4212-b7cd-61f1550b26aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:32.238711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 489/974] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 16:54:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:33.946709 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fa23a-b2db-4583-b9c3-91722f60001d None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:33.947217 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fa23a-b2db-4583-b9c3-91722f60001d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:33.947322 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fa23a-b2db-4583-b9c3-91722f60001d None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:33.948625 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 486/975] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 16:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:33.953954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3d3f-aa7e-4292-a65a-7ea8e159191a None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:33.954357 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3d3f-aa7e-4292-a65a-7ea8e159191a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:33.954509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3d3f-aa7e-4292-a65a-7ea8e159191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:33.972951 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-be0c3d3f-aa7e-4292-a65a-7ea8e159191a None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:33.974119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-be0c3d3f-aa7e-4292-a65a-7ea8e159191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:33.982452 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 490/976] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 16:54:33 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:54:37.882573 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4582-cacc-4b20-80be-65cd3a55ed24 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:37.883079 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4582-cacc-4b20-80be-65cd3a55ed24 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:37.883308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4582-cacc-4b20-80be-65cd3a55ed24 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:37.884845 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 487/977] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:37.890042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406bdf-85f9-4193-9732-c01235bebe10 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:37.890422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406bdf-85f9-4193-9732-c01235bebe10 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:37.891150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406bdf-85f9-4193-9732-c01235bebe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:37.908534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-77406bdf-85f9-4193-9732-c01235bebe10 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:37.909957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-77406bdf-85f9-4193-9732-c01235bebe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:37.919307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 491/978] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:37.970653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273ee5-405e-410f-ba75-f9f2b6b97cd4 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:37.970964 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273ee5-405e-410f-ba75-f9f2b6b97cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:37.971241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273ee5-405e-410f-ba75-f9f2b6b97cd4 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:37.972642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 488/979] 10.222.0.58 () {54 vars in 961 bytes} [Wed May 11 16:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:37.978129 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a552-143e-4976-8af3-6401143062df None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:37.978417 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a552-143e-4976-8af3-6401143062df None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:37.978761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a552-143e-4976-8af3-6401143062df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:38.015078 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-e9e3a552-143e-4976-8af3-6401143062df None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:38.016919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-e9e3a552-143e-4976-8af3-6401143062df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:38.085098 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 492/980] 10.222.0.58 () {58 vars in 1058 bytes} [Wed May 11 16:54:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:38.092885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2273ee5-405e-410f-ba75-f9f2b6b97cd4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:38.107509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2273ee5-405e-410f-ba75-f9f2b6b97cd4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:38.112801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:38.113530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:38.113907 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:38.114435 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:38.122993 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:38.124702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82ab1a-58df-4fa6-9142-f89df01c631b service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:38.135376 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 489/981] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 16:54:40.622943 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9372-0847-44d9-be78-f3676bc25ba5 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:40.623641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9372-0847-44d9-be78-f3676bc25ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:40.623641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9372-0847-44d9-be78-f3676bc25ba5 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:40.625569 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 493/982] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:40.630973 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a671f1b-1576-4b1a-affa-04b00ec24057 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:40.630973 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a671f1b-1576-4b1a-affa-04b00ec24057 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:40.631407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a671f1b-1576-4b1a-affa-04b00ec24057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:40.649877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-9a671f1b-1576-4b1a-affa-04b00ec24057 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:40.651071 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-9a671f1b-1576-4b1a-affa-04b00ec24057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:40.660864 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 490/983] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:40.705888 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9372-0847-44d9-be78-f3676bc25ba5 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:40.722593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9372-0847-44d9-be78-f3676bc25ba5 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:40.727846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:40.728430 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:40.728715 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:40.728993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:40.738416 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:40.740041 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e6b1e-fe56-4bfa-a323-40765f3b71f7 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:40.749606 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 494/984] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:43.299912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d870c9-a1d5-4c7b-ad71-5b8fe6668e54 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:43.300421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d870c9-a1d5-4c7b-ad71-5b8fe6668e54 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:43.300502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d870c9-a1d5-4c7b-ad71-5b8fe6668e54 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:43.302060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 491/985] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:43.307258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336a8-6287-4001-a42f-b592a8f82d29 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:43.307714 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336a8-6287-4001-a42f-b592a8f82d29 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:43.307874 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336a8-6287-4001-a42f-b592a8f82d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:43.327379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-fb0336a8-6287-4001-a42f-b592a8f82d29 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:43.328928 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-fb0336a8-6287-4001-a42f-b592a8f82d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:43.352574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 495/986] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:43.395060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555a77-405f-46e6-b2a8-2cb0ed392c8c None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:43.395601 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555a77-405f-46e6-b2a8-2cb0ed392c8c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:43.396103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555a77-405f-46e6-b2a8-2cb0ed392c8c None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:43.397599 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 492/987] 10.222.0.58 () {54 vars in 961 bytes} [Wed May 11 16:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:43.403310 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab04-5542-4117-a287-8f34455edb21 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:43.403616 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab04-5542-4117-a287-8f34455edb21 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:43.403950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab04-5542-4117-a287-8f34455edb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:43.423921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-fe0cab04-5542-4117-a287-8f34455edb21 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:43.425122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-fe0cab04-5542-4117-a287-8f34455edb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:43.433884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 496/988] 10.222.0.58 () {58 vars in 1058 bytes} [Wed May 11 16:54:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:43.441603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1555a77-405f-46e6-b2a8-2cb0ed392c8c None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:43.454837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1555a77-405f-46e6-b2a8-2cb0ed392c8c None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:43.460015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:43.460683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:43.460968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:43.461241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:43.470479 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:43.472303 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad548-022a-49e1-999f-6d128db20325 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:43.482059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 493/989] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:45.838375 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be26a7-76d3-409f-b7a6-4bccc5dfab2a None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:45.839435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be26a7-76d3-409f-b7a6-4bccc5dfab2a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:45.839932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be26a7-76d3-409f-b7a6-4bccc5dfab2a None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:45.847468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310cb3b-7057-4fad-9a92-e0d028beb6b4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:45.848275 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310cb3b-7057-4fad-9a92-e0d028beb6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:45.848779 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310cb3b-7057-4fad-9a92-e0d028beb6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:45.850298 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 497/990] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:45.866856 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7310cb3b-7057-4fad-9a92-e0d028beb6b4 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:45.868399 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7310cb3b-7057-4fad-9a92-e0d028beb6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:45.887685 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 494/991] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:45.922883 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be26a7-76d3-409f-b7a6-4bccc5dfab2a None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:45.936730 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be26a7-76d3-409f-b7a6-4bccc5dfab2a None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:45.942101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:45.942997 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:45.943509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:45.944010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:45.952629 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:45.955000 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a88ac-d2d0-4b6f-bab3-390c3c7c05b1 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:45.975794 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 498/992] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:47.769530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece254d-e091-49f0-a501-6d644e29d34a None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:47.769991 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece254d-e091-49f0-a501-6d644e29d34a None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:47.770099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece254d-e091-49f0-a501-6d644e29d34a None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:47.771934 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 495/993] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:47.781615 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba976-5741-449a-af63-133919322d5e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:47.782070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba976-5741-449a-af63-133919322d5e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:47.782156 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba976-5741-449a-af63-133919322d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:47.801249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-df9ba976-5741-449a-af63-133919322d5e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:47.802745 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-df9ba976-5741-449a-af63-133919322d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:47.824910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 499/994] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:48.163854 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8055b6-9105-4528-b4f2-ad8e1d8c0e2b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.164129 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8055b6-9105-4528-b4f2-ad8e1d8c0e2b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.164630 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8055b6-9105-4528-b4f2-ad8e1d8c0e2b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.166325 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 496/995] 10.222.0.58 () {54 vars in 963 bytes} [Wed May 11 16:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:48.171279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873ef-ac5d-4a87-8122-ab9713d8682b None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.171719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873ef-ac5d-4a87-8122-ab9713d8682b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.172002 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873ef-ac5d-4a87-8122-ab9713d8682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.209617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-833873ef-ac5d-4a87-8122-ab9713d8682b None None] MFA Rules not processed for user `24d4c4c8b0c740eeb45cae6aca0cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:48.211411 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-833873ef-ac5d-4a87-8122-ab9713d8682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:48.274501 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 500/996] 10.222.0.58 () {58 vars in 1060 bytes} [Wed May 11 16:54:48 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:48.282544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8055b6-9105-4528-b4f2-ad8e1d8c0e2b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:48.294346 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8055b6-9105-4528-b4f2-ad8e1d8c0e2b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:48.298246 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24d4c4c8b0c740eeb45cae6aca0cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:48.298884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.299164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.299462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.311019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:48.313068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3156e59-385e-4093-93b7-de093e38d6e1 service cinder] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:48.325225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 497/997] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:48.516691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53edc93-44a9-49bb-aa84-1a0b96b94e37 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.516976 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53edc93-44a9-49bb-aa84-1a0b96b94e37 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.517429 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53edc93-44a9-49bb-aa84-1a0b96b94e37 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.518786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 501/998] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:48.524060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2528-729a-4a01-bd0a-273471661800 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.524356 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2528-729a-4a01-bd0a-273471661800 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.524638 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2528-729a-4a01-bd0a-273471661800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.541796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-133f2528-729a-4a01-bd0a-273471661800 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:48.543103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-133f2528-729a-4a01-bd0a-273471661800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:48.550966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 498/999] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:48.596394 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53edc93-44a9-49bb-aa84-1a0b96b94e37 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:48.609669 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53edc93-44a9-49bb-aa84-1a0b96b94e37 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:48.616189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:48.616189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:48.616189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:48.616189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:48.625261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:48.627062 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac5716-8f02-4572-ab04-3a38fb59249f service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:48.641836 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 502/1000] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:50.968099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dc25-e9a5-4d23-985d-bf44e7cdb1ef None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:50.969536 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dc25-e9a5-4d23-985d-bf44e7cdb1ef None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:50.970034 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dc25-e9a5-4d23-985d-bf44e7cdb1ef None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:50.972068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 499/1001] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:50.978510 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c91c8-56f0-4487-98db-0b22fbc57ec5 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:50.978958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c91c8-56f0-4487-98db-0b22fbc57ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:50.979253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c91c8-56f0-4487-98db-0b22fbc57ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:51.005905 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-ad3c91c8-56f0-4487-98db-0b22fbc57ec5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:51.007366 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-ad3c91c8-56f0-4487-98db-0b22fbc57ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:51.016660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 503/1002] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:51.060991 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3dc25-e9a5-4d23-985d-bf44e7cdb1ef None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:51.073745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3dc25-e9a5-4d23-985d-bf44e7cdb1ef None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:51.079030 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:51.079687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:51.079965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:51.080237 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:51.088203 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:51.089769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292381b-4c6d-4b91-995a-0ecda1b02985 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:51.099338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 500/1003] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:53.414092 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e795-dcab-466c-8684-7b421b89212c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:53.415010 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e795-dcab-466c-8684-7b421b89212c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:53.415264 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e795-dcab-466c-8684-7b421b89212c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:53.419997 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 504/1004] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:53.422343 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133084c6-b211-4167-9feb-6350794caa9f None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:53.423233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133084c6-b211-4167-9feb-6350794caa9f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:53.423768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133084c6-b211-4167-9feb-6350794caa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:53.445289 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-133084c6-b211-4167-9feb-6350794caa9f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:53.446760 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-133084c6-b211-4167-9feb-6350794caa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:53.455334 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 501/1005] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:53.498202 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e795-dcab-466c-8684-7b421b89212c None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:53.512639 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e795-dcab-466c-8684-7b421b89212c None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:53.518178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:53.518804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:53.519087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:53.519380 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:53.527392 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:53.528966 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56bbf9-c5f4-49a7-9cf0-31d455ba6d56 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:53.544138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 505/1006] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:54:55.830721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cf9a-4edc-49b6-898b-fed3e10f7976 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:55.831298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cf9a-4edc-49b6-898b-fed3e10f7976 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:55.831298 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cf9a-4edc-49b6-898b-fed3e10f7976 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:55.833521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 502/1007] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:54:55.839395 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa197-f5d7-448d-8778-007842133b07 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:55.839987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa197-f5d7-448d-8778-007842133b07 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:55.839987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa197-f5d7-448d-8778-007842133b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:55.859560 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-7f0aa197-f5d7-448d-8778-007842133b07 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:55.860795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-7f0aa197-f5d7-448d-8778-007842133b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:55.869018 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 506/1008] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:54:55.913193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8cf9a-4edc-49b6-898b-fed3e10f7976 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:55.927583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8cf9a-4edc-49b6-898b-fed3e10f7976 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:55.932665 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:55.933402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:55.933702 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:55.933982 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:55.942442 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:55.944082 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaf39c-5061-4986-8cb8-3b94ef672243 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:55.953432 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 503/1009] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 16:54:58.642394 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69da-39f8-4b85-8feb-07053bb0d892 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:58.643335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69da-39f8-4b85-8feb-07053bb0d892 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:58.643335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69da-39f8-4b85-8feb-07053bb0d892 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:58.644379 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 507/1010] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:54:58.649849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76c8f-821f-42c6-89d7-f439645a7914 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:58.650276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76c8f-821f-42c6-89d7-f439645a7914 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:58.650603 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76c8f-821f-42c6-89d7-f439645a7914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:58.668651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-5ec76c8f-821f-42c6-89d7-f439645a7914 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:54:58.669841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-5ec76c8f-821f-42c6-89d7-f439645a7914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:54:58.678000 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 504/1011] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:54:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:54:58.725145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c69da-39f8-4b85-8feb-07053bb0d892 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:54:58.738474 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c69da-39f8-4b85-8feb-07053bb0d892 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:54:58.743286 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:54:58.743949 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:54:58.744234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:54:58.744514 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:54:58.752563 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:54:58.754128 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd6adb-a7ad-4cc5-b61b-74b298ec7322 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:54:58.763392 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 508/1012] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:54:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:01.990831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe2bf-adc2-4c14-a46e-c4004ed55c3f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:01.991981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe2bf-adc2-4c14-a46e-c4004ed55c3f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:01.991981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe2bf-adc2-4c14-a46e-c4004ed55c3f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:01.992940 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 505/1013] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:01.998347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ea35-5ac1-487c-8e68-ba895064eb5d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:01.999985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ea35-5ac1-487c-8e68-ba895064eb5d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:01.999985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ea35-5ac1-487c-8e68-ba895064eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:02.022435 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9f40ea35-5ac1-487c-8e68-ba895064eb5d None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:02.023775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9f40ea35-5ac1-487c-8e68-ba895064eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:02.031518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 509/1014] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:55:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:02.075472 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfe2bf-adc2-4c14-a46e-c4004ed55c3f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:02.089117 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfe2bf-adc2-4c14-a46e-c4004ed55c3f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:02.093873 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:02.094503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:02.094782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:02.095056 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:02.102883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:02.104478 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd845a-7fdb-4d0a-ae23-59c130d9ba11 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:02.113620 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 506/1015] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:04.192204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a70ed-fc4e-4640-bdc8-2ce9111e62fa None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.192890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a70ed-fc4e-4640-bdc8-2ce9111e62fa None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.192890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a70ed-fc4e-4640-bdc8-2ce9111e62fa None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.194110 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 510/1016] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:04.199194 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7fa2-41fd-42c8-bf30-5b2172fb4571 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.199703 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7fa2-41fd-42c8-bf30-5b2172fb4571 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.199800 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7fa2-41fd-42c8-bf30-5b2172fb4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.217615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-96ca7fa2-41fd-42c8-bf30-5b2172fb4571 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:04.218802 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-96ca7fa2-41fd-42c8-bf30-5b2172fb4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:04.226625 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 507/1017] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:55:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:04.285105 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5159-cbce-4db9-90eb-2d0b10bfa4ff None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.285390 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5159-cbce-4db9-90eb-2d0b10bfa4ff None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.285668 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5159-cbce-4db9-90eb-2d0b10bfa4ff None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.287008 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 511/1018] 10.222.0.58 () {54 vars in 962 bytes} [Wed May 11 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:04.292120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092724-673a-4132-a85a-24ea57a874a0 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.292409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092724-673a-4132-a85a-24ea57a874a0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.292685 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092724-673a-4132-a85a-24ea57a874a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.331098 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-5d092724-673a-4132-a85a-24ea57a874a0 None None] MFA Rules not processed for user `29e72d051cbc4630a7e0e197a6df5369`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:04.332570 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-5d092724-673a-4132-a85a-24ea57a874a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:04.388906 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 508/1019] 10.222.0.58 () {58 vars in 1059 bytes} [Wed May 11 16:55:04 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:04.397136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5159-cbce-4db9-90eb-2d0b10bfa4ff None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:04.407410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5159-cbce-4db9-90eb-2d0b10bfa4ff None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:04.410884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e72d051cbc4630a7e0e197a6df5369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:04.411543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.411826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.412101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.420711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:04.422151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b2e5-5770-4fdc-a88c-5eb476f40b32 service glance] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:04.431335 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 512/1020] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:04.437898 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109be81-3386-4485-bba6-3500358d482b None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.438187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109be81-3386-4485-bba6-3500358d482b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.438465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109be81-3386-4485-bba6-3500358d482b None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.439976 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 509/1021] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:04.445023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c6a-d448-4f8b-8065-932d00e39167 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.445258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c6a-d448-4f8b-8065-932d00e39167 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.445538 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c6a-d448-4f8b-8065-932d00e39167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.463769 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4b2f4c6a-d448-4f8b-8065-932d00e39167 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:04.464957 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4b2f4c6a-d448-4f8b-8065-932d00e39167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:04.473919 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 513/1022] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:55:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:55:04.519225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109be81-3386-4485-bba6-3500358d482b None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:04.532555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109be81-3386-4485-bba6-3500358d482b None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:04.537454 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:04.538083 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:04.538367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:04.538643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:04.546989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:04.548622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf685e8f-d5df-4008-982e-5b196445c7d5 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:04.558136 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 510/1023] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:06.893631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6a5c5-9463-417c-a69d-4a4bcd677459 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:06.894291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6a5c5-9463-417c-a69d-4a4bcd677459 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:06.894291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6a5c5-9463-417c-a69d-4a4bcd677459 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:06.895699 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 514/1024] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:06.900687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683873-f3fd-402a-a7bb-9de0b4e36884 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:06.901174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683873-f3fd-402a-a7bb-9de0b4e36884 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:06.901272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683873-f3fd-402a-a7bb-9de0b4e36884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:06.921386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d2683873-f3fd-402a-a7bb-9de0b4e36884 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:06.921386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d2683873-f3fd-402a-a7bb-9de0b4e36884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:06.936282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 511/1025] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:55:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:55:06.981522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6a5c5-9463-417c-a69d-4a4bcd677459 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:06.995142 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6a5c5-9463-417c-a69d-4a4bcd677459 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:07.000987 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:07.001696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:07.002042 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:07.002380 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:07.010815 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:07.012509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825efcf-ef6b-4c6b-8e36-01f04d4a6d56 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:07.021866 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 515/1026] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:19.739267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13b97-6e2e-4916-a4e1-fc840d60fee6 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:19.739961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13b97-6e2e-4916-a4e1-fc840d60fee6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:19.739961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13b97-6e2e-4916-a4e1-fc840d60fee6 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:19.741155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 512/1027] 10.222.0.58 () {54 vars in 918 bytes} [Wed May 11 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:19.746362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fd66c-da40-4829-9d27-61d2c0580978 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:19.746827 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fd66c-da40-4829-9d27-61d2c0580978 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:19.746931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fd66c-da40-4829-9d27-61d2c0580978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:19.764691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2c3fd66c-da40-4829-9d27-61d2c0580978 None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:19.765870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2c3fd66c-da40-4829-9d27-61d2c0580978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:19.774077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 516/1028] 10.222.0.58 () {58 vars in 1015 bytes} [Wed May 11 16:55:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:19.788241 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09868-12b5-4e55-a7c0-03fd96187458 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:19.788531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09868-12b5-4e55-a7c0-03fd96187458 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:19.788831 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09868-12b5-4e55-a7c0-03fd96187458 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:19.790157 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 513/1029] 10.222.0.58 () {54 vars in 918 bytes} [Wed May 11 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:19.794617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e38b6-dd53-46d4-aa4e-3a8b08b97b67 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:19.794903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e38b6-dd53-46d4-aa4e-3a8b08b97b67 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:19.795204 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e38b6-dd53-46d4-aa4e-3a8b08b97b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:19.813270 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9e5e38b6-dd53-46d4-aa4e-3a8b08b97b67 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:19.814408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9e5e38b6-dd53-46d4-aa4e-3a8b08b97b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:19.822577 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 517/1030] 10.222.0.58 () {58 vars in 1015 bytes} [Wed May 11 16:55:19 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:55:22.553087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a86b-69ff-4077-b7f9-c50b22a911fd None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:22.553653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a86b-69ff-4077-b7f9-c50b22a911fd None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:22.553653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a86b-69ff-4077-b7f9-c50b22a911fd None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:22.554981 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:22.560136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b165-fcfd-414e-8996-315da8549c48 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:22.560596 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b165-fcfd-414e-8996-315da8549c48 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:22.560694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b165-fcfd-414e-8996-315da8549c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:22.579035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9ba3b165-fcfd-414e-8996-315da8549c48 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:22.580235 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9ba3b165-fcfd-414e-8996-315da8549c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:22.588150 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:22.630690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5a86b-69ff-4077-b7f9-c50b22a911fd None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:22.643595 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5a86b-69ff-4077-b7f9-c50b22a911fd None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:22.648449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:22.649074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:22.649355 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:22.649632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:22.657328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:22.658920 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3051ac0-238a-4093-b71b-2b5c90a9de35 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:22.668058 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 515/1033] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:23.679778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eabce-51f2-4121-8b5f-80a36d6e5d49 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:23.680312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eabce-51f2-4121-8b5f-80a36d6e5d49 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:23.680312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eabce-51f2-4121-8b5f-80a36d6e5d49 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:23.681713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:23.686948 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928e7d-39af-431d-9ed2-02bee3a1e1d0 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:23.687423 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928e7d-39af-431d-9ed2-02bee3a1e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:23.687541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928e7d-39af-431d-9ed2-02bee3a1e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:23.705402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-02928e7d-39af-431d-9ed2-02bee3a1e1d0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:23.706572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-02928e7d-39af-431d-9ed2-02bee3a1e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:23.714656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:23.917959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eabce-51f2-4121-8b5f-80a36d6e5d49 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:23.931475 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eabce-51f2-4121-8b5f-80a36d6e5d49 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:23.936344 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:23.936967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:23.937244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:23.937515 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:23.945353 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:23.946906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8ef91-6771-417f-ac89-07307ceebd57 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:23.956038 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 520/1036] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:24.908338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908dcd-978d-4a43-a3cf-ee8dca18bacd None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:24.908881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908dcd-978d-4a43-a3cf-ee8dca18bacd None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:24.908881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908dcd-978d-4a43-a3cf-ee8dca18bacd None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:24.910187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:24.914976 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9e9e-ff45-4eb7-9430-3894d241379e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:24.915424 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9e9e-ff45-4eb7-9430-3894d241379e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:24.915567 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9e9e-ff45-4eb7-9430-3894d241379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:24.932893 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-d87b9e9e-ff45-4eb7-9430-3894d241379e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:24.934051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-d87b9e9e-ff45-4eb7-9430-3894d241379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:24.941664 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:25.093594 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908dcd-978d-4a43-a3cf-ee8dca18bacd None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:25.106604 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908dcd-978d-4a43-a3cf-ee8dca18bacd None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:25.111468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:25.112093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:25.112377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:25.112683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:25.120440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:25.122005 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0b6f8-a617-46ee-9183-c5c56cfda009 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:25.131851 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 518/1039] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:26.054140 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363d4e-eec2-41d5-ae6e-2255dc3024c4 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:26.054691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363d4e-eec2-41d5-ae6e-2255dc3024c4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:26.054691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363d4e-eec2-41d5-ae6e-2255dc3024c4 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:26.056139 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:26.061204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482946-2ba8-476a-888b-ee5251102d18 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:26.061600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482946-2ba8-476a-888b-ee5251102d18 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:26.061761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482946-2ba8-476a-888b-ee5251102d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:26.079327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8a482946-2ba8-476a-888b-ee5251102d18 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:26.080516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8a482946-2ba8-476a-888b-ee5251102d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:26.088411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:26.243884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2363d4e-eec2-41d5-ae6e-2255dc3024c4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:26.256808 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2363d4e-eec2-41d5-ae6e-2255dc3024c4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:26.261621 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:26.262250 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:26.262543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:26.262802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:26.271110 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:26.272711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc5f7-c477-46a1-aa6e-385caa7fb2f9 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:26.282275 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 523/1042] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:27.204711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc4c4-7bb7-46ed-a3aa-af6b2d67875a None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:27.205277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc4c4-7bb7-46ed-a3aa-af6b2d67875a None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:27.205277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc4c4-7bb7-46ed-a3aa-af6b2d67875a None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:27.206624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 16:55:27.211628 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b442-f900-4063-af49-41533b6772c5 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:27.212050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b442-f900-4063-af49-41533b6772c5 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:27.212214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b442-f900-4063-af49-41533b6772c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:27.229607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a239b442-f900-4063-af49-41533b6772c5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:27.230762 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a239b442-f900-4063-af49-41533b6772c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:27.238871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:27.391795 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc4c4-7bb7-46ed-a3aa-af6b2d67875a None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:27.405158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc4c4-7bb7-46ed-a3aa-af6b2d67875a None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:27.409976 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:27.410608 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:27.410885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:27.411154 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:27.418888 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:27.421092 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41d5da-89d5-45e1-80c0-ffeba1019e6c service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:27.429969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 521/1045] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:28.307249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8299a-f697-4d8d-a1f1-3769c091652f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:28.307844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8299a-f697-4d8d-a1f1-3769c091652f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:28.307844 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8299a-f697-4d8d-a1f1-3769c091652f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:28.309233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:28.314106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e34be-dc5c-4239-8aba-6c70c09e0850 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:28.314512 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e34be-dc5c-4239-8aba-6c70c09e0850 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:28.314687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e34be-dc5c-4239-8aba-6c70c09e0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:28.332787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-715e34be-dc5c-4239-8aba-6c70c09e0850 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:28.333933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-715e34be-dc5c-4239-8aba-6c70c09e0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:28.341473 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:28.494538 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8299a-f697-4d8d-a1f1-3769c091652f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:28.507657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8299a-f697-4d8d-a1f1-3769c091652f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:28.512496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:28.513118 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:28.513401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:28.513678 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:28.521981 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:28.523579 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f58db-f20a-47bc-9ae5-ca3cc4665add service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:28.533228 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 526/1048] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:29.399443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa42d-1f72-400f-9299-230f9c42c5b3 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:29.399988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa42d-1f72-400f-9299-230f9c42c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:29.399988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa42d-1f72-400f-9299-230f9c42c5b3 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:29.401337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:29.406349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029196-f840-417d-b499-47f267fdfbda None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:29.406796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029196-f840-417d-b499-47f267fdfbda None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:29.406908 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029196-f840-417d-b499-47f267fdfbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:29.424646 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-47029196-f840-417d-b499-47f267fdfbda None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:29.425811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-47029196-f840-417d-b499-47f267fdfbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:29.433497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:55:29.584394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aa42d-1f72-400f-9299-230f9c42c5b3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:29.597480 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aa42d-1f72-400f-9299-230f9c42c5b3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:29.602367 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:29.602992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:29.603272 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:29.603571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:29.611928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:29.613502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5980e4c-1dc7-4380-9284-db0575f53f55 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:29.622399 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 524/1051] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:30.525713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9b96-9a70-48ca-ac19-8b6ec3240f5a None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:30.526269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9b96-9a70-48ca-ac19-8b6ec3240f5a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:30.526269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e9b96-9a70-48ca-ac19-8b6ec3240f5a None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:30.527657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:30.533020 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f4db-3809-40e9-b267-40252b3f78e5 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:30.533464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f4db-3809-40e9-b267-40252b3f78e5 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:30.533562 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f4db-3809-40e9-b267-40252b3f78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:30.551643 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7729f4db-3809-40e9-b267-40252b3f78e5 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:30.552799 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7729f4db-3809-40e9-b267-40252b3f78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:30.560683 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:30.716261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e9b96-9a70-48ca-ac19-8b6ec3240f5a None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:30.729846 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e9b96-9a70-48ca-ac19-8b6ec3240f5a None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:30.735207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:30.735876 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:30.736159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:30.736431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:30.744263 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:30.745818 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46030-d238-431b-acba-f0230ee5a393 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:30.754940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 529/1054] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:31.627031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5d44-8c30-42df-a058-4ca8e05f6a86 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:31.627618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5d44-8c30-42df-a058-4ca8e05f6a86 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:31.627618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5d44-8c30-42df-a058-4ca8e05f6a86 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:31.628956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:31.633711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee31e4-1690-4117-83ab-49ec921e4f09 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:31.634132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee31e4-1690-4117-83ab-49ec921e4f09 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:31.634271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee31e4-1690-4117-83ab-49ec921e4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:31.651589 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-c9ee31e4-1690-4117-83ab-49ec921e4f09 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:31.652767 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c9ee31e4-1690-4117-83ab-49ec921e4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:31.660540 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:55:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:31.814912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5d44-8c30-42df-a058-4ca8e05f6a86 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:31.827860 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5d44-8c30-42df-a058-4ca8e05f6a86 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:31.832956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:31.833582 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:31.833866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:31.834140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:31.841891 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:31.843490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632e59-c919-4f69-9cac-bae5cc44d095 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:31.852399 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 527/1057] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:34.011398 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ccb-9faf-47b8-97ee-c5b5bc13be2b None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:34.011940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ccb-9faf-47b8-97ee-c5b5bc13be2b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:34.011940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9ccb-9faf-47b8-97ee-c5b5bc13be2b None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:34.013293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:34.018487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24727fc-7982-4e39-8a38-10b1db9723b1 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:34.018892 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24727fc-7982-4e39-8a38-10b1db9723b1 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:34.019060 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24727fc-7982-4e39-8a38-10b1db9723b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:34.035965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-b24727fc-7982-4e39-8a38-10b1db9723b1 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:34.037158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-b24727fc-7982-4e39-8a38-10b1db9723b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:34.044645 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:34.084507 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9ccb-9faf-47b8-97ee-c5b5bc13be2b None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:34.096988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9ccb-9faf-47b8-97ee-c5b5bc13be2b None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:34.104198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:34.104835 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:34.105115 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:34.105408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:34.117347 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:34.118769 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621222f4-e19f-485a-8987-59a252d28d2e service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:34.128954 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 532/1060] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:36.537225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e20c-4af9-4854-aa5d-14b448d5221c None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:36.537737 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e20c-4af9-4854-aa5d-14b448d5221c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:36.537833 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e20c-4af9-4854-aa5d-14b448d5221c None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:36.539120 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:36.544328 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207ca1-2ee9-4eab-bf88-72bbeea77f02 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:36.544732 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207ca1-2ee9-4eab-bf88-72bbeea77f02 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:36.544884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207ca1-2ee9-4eab-bf88-72bbeea77f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:36.562622 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-47207ca1-2ee9-4eab-bf88-72bbeea77f02 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:36.563831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-47207ca1-2ee9-4eab-bf88-72bbeea77f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:36.572310 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:55:36.612134 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e20c-4af9-4854-aa5d-14b448d5221c None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:36.622451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e20c-4af9-4854-aa5d-14b448d5221c None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:36.626372 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:36.626999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:36.627281 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:36.627583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:36.636078 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:36.637505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4823ab-1030-4cdc-ac3a-dcf7a39a1cc7 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:36.647090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 530/1063] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:39.235462 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213029-1681-4e57-afd9-b3b781cee2d7 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:39.236024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213029-1681-4e57-afd9-b3b781cee2d7 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:39.236024 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213029-1681-4e57-afd9-b3b781cee2d7 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:39.237344 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:39.242602 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41187d9-2639-444f-84d6-ac6235f34e31 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:39.243057 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41187d9-2639-444f-84d6-ac6235f34e31 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:39.243155 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41187d9-2639-444f-84d6-ac6235f34e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:39.260139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-a41187d9-2639-444f-84d6-ac6235f34e31 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:39.261323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-a41187d9-2639-444f-84d6-ac6235f34e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:39.269461 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:39.307562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b213029-1681-4e57-afd9-b3b781cee2d7 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:39.317778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b213029-1681-4e57-afd9-b3b781cee2d7 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:39.321186 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:39.321801 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:39.322078 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:39.322349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:39.331775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:39.333473 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab336b-ffbe-40af-a754-f429967e6ed9 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:39.343082 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 535/1066] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:41.740903 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7792-a980-4cb1-bf05-75aaef3c3edd None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:41.741468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7792-a980-4cb1-bf05-75aaef3c3edd None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:41.741468 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7792-a980-4cb1-bf05-75aaef3c3edd None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:41.742743 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:41.747900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6b08-f7d4-476a-8539-d53d0bb9d816 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:41.748307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6b08-f7d4-476a-8539-d53d0bb9d816 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:41.748484 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d6b08-f7d4-476a-8539-d53d0bb9d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:41.765543 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-b33d6b08-f7d4-476a-8539-d53d0bb9d816 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:41.766718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-b33d6b08-f7d4-476a-8539-d53d0bb9d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:41.774785 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:41.815475 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7792-a980-4cb1-bf05-75aaef3c3edd None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:41.826971 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7792-a980-4cb1-bf05-75aaef3c3edd None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:41.830513 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:41.831146 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:41.831540 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:41.831818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:41.840691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:41.842629 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0569b96-1586-48c7-8541-d9b96f0a7073 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:41.851615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 533/1069] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:44.146418 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ccf8-b79c-4d94-9e6c-2a98386e845d None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:44.146988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ccf8-b79c-4d94-9e6c-2a98386e845d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:44.146988 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ccf8-b79c-4d94-9e6c-2a98386e845d None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:44.148337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:44.153618 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163087d-9f76-469f-b21f-51ff120a42d3 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:44.154242 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163087d-9f76-469f-b21f-51ff120a42d3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:44.154865 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163087d-9f76-469f-b21f-51ff120a42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:44.172796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-1163087d-9f76-469f-b21f-51ff120a42d3 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:44.173987 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-1163087d-9f76-469f-b21f-51ff120a42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:44.181636 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:44.219701 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ccf8-b79c-4d94-9e6c-2a98386e845d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:44.229904 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ccf8-b79c-4d94-9e6c-2a98386e845d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:44.233890 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:44.234528 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:44.234804 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:44.235074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:44.243579 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:44.244979 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73745-e8b5-4805-9c9c-ff8862f72b8e service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:44.254135 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 538/1072] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:46.594894 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f76f-ae97-4c77-a24b-c1b0e63cef47 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:46.595462 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f76f-ae97-4c77-a24b-c1b0e63cef47 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:46.595576 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f76f-ae97-4c77-a24b-c1b0e63cef47 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:46.596904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:46.602019 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c60a9-5295-48e0-8f9c-cf53cdd80825 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:46.602413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c60a9-5295-48e0-8f9c-cf53cdd80825 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:46.602575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c60a9-5295-48e0-8f9c-cf53cdd80825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:46.620159 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a67c60a9-5295-48e0-8f9c-cf53cdd80825 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:46.621331 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a67c60a9-5295-48e0-8f9c-cf53cdd80825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:46.629558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:46.667457 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f76f-ae97-4c77-a24b-c1b0e63cef47 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:46.678270 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f76f-ae97-4c77-a24b-c1b0e63cef47 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:46.681725 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:46.682351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:46.682632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:46.682904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:46.692119 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:46.693526 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffea49-6e16-451b-a3b3-8c6776d3e6d5 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:46.703687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 536/1075] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:49.006778 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3e35-da21-4921-84fd-61881cb7be70 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:49.007369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3e35-da21-4921-84fd-61881cb7be70 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:49.007369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3e35-da21-4921-84fd-61881cb7be70 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:49.008713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:49.014407 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9923-6b6f-4bd9-964b-b62651349e69 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:49.014855 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9923-6b6f-4bd9-964b-b62651349e69 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:49.014966 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9923-6b6f-4bd9-964b-b62651349e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:49.032402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-cbdc9923-6b6f-4bd9-964b-b62651349e69 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:49.033571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-cbdc9923-6b6f-4bd9-964b-b62651349e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:49.041042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:49.080102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc3e35-da21-4921-84fd-61881cb7be70 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:49.090555 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc3e35-da21-4921-84fd-61881cb7be70 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:49.094718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:49.095337 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:49.095644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:49.095916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:49.104864 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:49.106289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20a082-f19f-4ed2-8ae0-756c71d9e6d8 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:49.115451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 541/1078] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:51.424477 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3988-6473-43ef-9599-cbe8d695bf60 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:51.425040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3988-6473-43ef-9599-cbe8d695bf60 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:51.425040 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3988-6473-43ef-9599-cbe8d695bf60 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:51.426402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:51.431625 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909aa5-b5e0-4654-b3f3-3dd49f7ead40 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:51.432029 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909aa5-b5e0-4654-b3f3-3dd49f7ead40 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:51.432172 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909aa5-b5e0-4654-b3f3-3dd49f7ead40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:51.449911 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-64909aa5-b5e0-4654-b3f3-3dd49f7ead40 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:51.451157 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-64909aa5-b5e0-4654-b3f3-3dd49f7ead40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:51.459613 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:51.498613 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3988-6473-43ef-9599-cbe8d695bf60 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:51.509191 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3988-6473-43ef-9599-cbe8d695bf60 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:51.512730 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:51.513362 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:51.514187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:51.514471 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:51.523068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:51.524521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77413da-0431-45ee-8c60-81d125bdc33b service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:51.533557 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 539/1081] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:53.843431 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a876-6e74-4837-bc4e-f65194850c9c None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:53.843963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a876-6e74-4837-bc4e-f65194850c9c None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:53.843963 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a876-6e74-4837-bc4e-f65194850c9c None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:53.845273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:53.850483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228abb-fcfb-42e3-ac46-2d19105e4053 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:53.850878 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228abb-fcfb-42e3-ac46-2d19105e4053 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:53.851038 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228abb-fcfb-42e3-ac46-2d19105e4053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:53.868569 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-10228abb-fcfb-42e3-ac46-2d19105e4053 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:53.869787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-10228abb-fcfb-42e3-ac46-2d19105e4053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:53.877935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:53.914307 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7a876-6e74-4837-bc4e-f65194850c9c None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:53.924504 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7a876-6e74-4837-bc4e-f65194850c9c None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:53.927879 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:53.928498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:53.928776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:53.929045 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:53.938068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:53.939499 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795fea6-487a-468b-a927-634211caa569 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:53.948522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 544/1084] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:55:56.224163 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c7f-d40f-478a-802c-0dcfaf9f3212 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:56.224723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c7f-d40f-478a-802c-0dcfaf9f3212 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:56.224723 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c7f-d40f-478a-802c-0dcfaf9f3212 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:56.226117 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:55:56.231287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b05c-4ff8-408e-806d-0b0598af002e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:56.231731 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b05c-4ff8-408e-806d-0b0598af002e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:56.231878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b05c-4ff8-408e-806d-0b0598af002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:56.249630 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-ed86b05c-4ff8-408e-806d-0b0598af002e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:55:56.250805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-ed86b05c-4ff8-408e-806d-0b0598af002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:55:56.258497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:55:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:55:56.295925 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6c7f-d40f-478a-802c-0dcfaf9f3212 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:55:56.306100 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6c7f-d40f-478a-802c-0dcfaf9f3212 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:55:56.309733 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:55:56.310393 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:55:56.310674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:55:56.310945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:55:56.319463 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:55:56.320881 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06450ab4-49ef-4b0f-983b-01775542c419 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:55:56.330347 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 542/1087] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:55:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:56:31.156914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae441-96f2-4698-bc7a-76e9ef3da2b4 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:31.157519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae441-96f2-4698-bc7a-76e9ef3da2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:31.157519 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae441-96f2-4698-bc7a-76e9ef3da2b4 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:31.158792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 546/1088] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:31.164062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcb31d-b45c-422e-9e30-e663b7337b64 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:31.164493 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcb31d-b45c-422e-9e30-e663b7337b64 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:31.164624 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcb31d-b45c-422e-9e30-e663b7337b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:31.181597 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-5fdcb31d-b45c-422e-9e30-e663b7337b64 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:31.182796 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-5fdcb31d-b45c-422e-9e30-e663b7337b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:31.190935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 543/1089] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:31.239237 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76507-adb7-44d6-b8eb-c727238510d0 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:31.239578 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76507-adb7-44d6-b8eb-c727238510d0 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:31.239855 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd76507-adb7-44d6-b8eb-c727238510d0 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:31.241210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 547/1090] 10.222.0.58 () {54 vars in 962 bytes} [Wed May 11 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:31.246127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc00-3fda-4dc2-90f9-5f3ee63a5c15 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:31.246417 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc00-3fda-4dc2-90f9-5f3ee63a5c15 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:31.246694 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc00-3fda-4dc2-90f9-5f3ee63a5c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:31.265122 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-41f0fc00-3fda-4dc2-90f9-5f3ee63a5c15 None None] MFA Rules not processed for user `29e72d051cbc4630a7e0e197a6df5369`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:31.266286 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-41f0fc00-3fda-4dc2-90f9-5f3ee63a5c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:31.272560 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 544/1091] 10.222.0.58 () {58 vars in 1059 bytes} [Wed May 11 16:56:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:31.279861 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd76507-adb7-44d6-b8eb-c727238510d0 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:31.289973 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd76507-adb7-44d6-b8eb-c727238510d0 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:31.293382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e72d051cbc4630a7e0e197a6df5369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:31.293985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:31.294261 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:31.294531 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:31.302882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:31.304300 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64f955-a9fd-4380-bb86-df69b40a7b9f service glance] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:31.313747 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 548/1092] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:56:33.667671 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85a8-1ef7-4810-80fa-9a9cd3f4e630 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:33.668229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85a8-1ef7-4810-80fa-9a9cd3f4e630 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:33.668229 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85a8-1ef7-4810-80fa-9a9cd3f4e630 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:33.670093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 545/1093] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:33.675711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458779-b222-461b-8bf0-549553ef4679 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:33.676141 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458779-b222-461b-8bf0-549553ef4679 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:33.676249 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458779-b222-461b-8bf0-549553ef4679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:33.693169 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-8c458779-b222-461b-8bf0-549553ef4679 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:33.694319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-8c458779-b222-461b-8bf0-549553ef4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:33.701964 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 549/1094] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:33.726227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e85a8-1ef7-4810-80fa-9a9cd3f4e630 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:33.738670 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e85a8-1ef7-4810-80fa-9a9cd3f4e630 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:33.742924 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:33.743589 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:33.743870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:33.744141 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:33.744862 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:33.746583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:56:33.746583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 16:56:33.746583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 16:56:33.747792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9aa70-0ee4-44d2-971b-4c03467c7df2 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:33.765345 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 546/1095] 10.222.0.58 () {56 vars in 1108 bytes} [Wed May 11 16:56:33 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:56:36.045382 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4320-a49a-4f2b-b336-1f7a3464223b None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:36.045921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4320-a49a-4f2b-b336-1f7a3464223b None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:36.045921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4320-a49a-4f2b-b336-1f7a3464223b None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:36.047283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 550/1096] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:36.052420 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22d1cb-fbed-4a6e-bad9-b130c2a0c45b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:36.052825 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22d1cb-fbed-4a6e-bad9-b130c2a0c45b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:36.053001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22d1cb-fbed-4a6e-bad9-b130c2a0c45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:36.071015 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ed22d1cb-fbed-4a6e-bad9-b130c2a0c45b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:36.072294 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ed22d1cb-fbed-4a6e-bad9-b130c2a0c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:36.079910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 547/1097] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:36.122870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd4320-a49a-4f2b-b336-1f7a3464223b None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:36.135776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd4320-a49a-4f2b-b336-1f7a3464223b None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:36.140601 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:36.141228 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:36.141508 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:36.141783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:36.149581 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:36.151160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42690b6-f3e3-4717-88c8-e5274754e074 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:36.160231 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 551/1098] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:56:38.594156 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2632910-7fd7-48f9-ad52-be7c81fa78a8 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:38.594696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2632910-7fd7-48f9-ad52-be7c81fa78a8 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:38.594696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2632910-7fd7-48f9-ad52-be7c81fa78a8 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:38.596108 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 548/1099] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:38.601317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f96fc-4624-4e87-bdaa-af2ce006e1cf None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:38.601772 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f96fc-4624-4e87-bdaa-af2ce006e1cf None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:38.601887 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f96fc-4624-4e87-bdaa-af2ce006e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:38.619005 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-116f96fc-4624-4e87-bdaa-af2ce006e1cf None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:38.620195 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-116f96fc-4624-4e87-bdaa-af2ce006e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:38.628317 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 552/1100] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:38.664375 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2632910-7fd7-48f9-ad52-be7c81fa78a8 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:38.674653 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2632910-7fd7-48f9-ad52-be7c81fa78a8 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:38.678038 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:38.678658 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:38.678933 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:38.679204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:38.688065 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:38.689482 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fad5c-e1cd-4edb-9210-15b872a3c52f service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:38.698393 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 549/1101] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 16:56:41.001361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5b5a-30ed-4f49-8cdc-3a33d02c92cc None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:41.001914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5b5a-30ed-4f49-8cdc-3a33d02c92cc None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:41.001914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5b5a-30ed-4f49-8cdc-3a33d02c92cc None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:41.003255 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 553/1102] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:41.008487 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aa43-5945-435b-85e2-297b565bebb6 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:41.008870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aa43-5945-435b-85e2-297b565bebb6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:41.009050 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aa43-5945-435b-85e2-297b565bebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:41.026607 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7ca3aa43-5945-435b-85e2-297b565bebb6 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:41.027818 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7ca3aa43-5945-435b-85e2-297b565bebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:41.035937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 550/1103] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:41.073775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5b5a-30ed-4f49-8cdc-3a33d02c92cc None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:41.084353 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5b5a-30ed-4f49-8cdc-3a33d02c92cc None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:41.087791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:41.088410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:41.088689 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:41.088962 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:41.098050 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:41.099492 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5720b51-ba83-410e-b172-face9973082d service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:41.109102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 554/1104] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:56:43.509355 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e2b-1e14-4a66-bdd4-763c64487d7d None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:43.509932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e2b-1e14-4a66-bdd4-763c64487d7d None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:43.509932 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e2b-1e14-4a66-bdd4-763c64487d7d None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:43.511279 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 551/1105] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:43.518090 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c747b-ec3b-41a4-8ea7-f506726c46ab None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:43.518556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c747b-ec3b-41a4-8ea7-f506726c46ab None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:43.518667 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c747b-ec3b-41a4-8ea7-f506726c46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:43.537284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-c33c747b-ec3b-41a4-8ea7-f506726c46ab None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:43.538451 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c33c747b-ec3b-41a4-8ea7-f506726c46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:43.546801 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 555/1106] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:43.586853 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990e2b-1e14-4a66-bdd4-763c64487d7d None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:43.597164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990e2b-1e14-4a66-bdd4-763c64487d7d None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:43.600612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:43.601233 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:43.601510 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:43.601780 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:43.610794 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:43.612239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5923d-8e07-425a-8665-cf66d1a9f29b service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:43.621130 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 552/1107] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:56:46.071198 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052bfd-4f59-40cd-8876-3c90ec609a0e None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:46.071812 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052bfd-4f59-40cd-8876-3c90ec609a0e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:46.071812 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052bfd-4f59-40cd-8876-3c90ec609a0e None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:46.073117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 556/1108] 10.222.0.58 () {54 vars in 926 bytes} [Wed May 11 16:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:56:46.078335 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e73-0fdf-412a-ab3f-848b7c2cf1e6 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:46.078765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e73-0fdf-412a-ab3f-848b7c2cf1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:46.078900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e73-0fdf-412a-ab3f-848b7c2cf1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:46.097745 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-2f514e73-0fdf-412a-ab3f-848b7c2cf1e6 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:56:46.098923 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-2f514e73-0fdf-412a-ab3f-848b7c2cf1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:56:46.107252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 553/1109] 10.222.0.58 () {58 vars in 1023 bytes} [Wed May 11 16:56:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:56:46.145244 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80052bfd-4f59-40cd-8876-3c90ec609a0e None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:56:46.156014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80052bfd-4f59-40cd-8876-3c90ec609a0e None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:56:46.159637 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:56:46.160330 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:56:46.160770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:56:46.161147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:56:46.171640 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:56:46.173035 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1061-185c-4cb3-9488-2b988cdc5b77 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:56:46.181896 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 557/1110] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:56:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:58:15.014505 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.015089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.015089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.032735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:58:15.033899 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.041426 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 554/1111] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:58:15.050759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.051296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.051296 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.068371 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:58:15.069527 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.077897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 558/1112] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:58:15.082224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.092409 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4339ed-80c5-41aa-8ac3-df18f50b3197 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.096866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.097504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.097782 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.098054 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.098759 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 16:58:15.099057 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.100093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.100093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 16:58:15.100093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 16:58:15.100970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.111813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 555/1113] 10.222.0.58 () {58 vars in 1152 bytes} [Wed May 11 16:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:58:15.119534 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.128217 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb456f-0585-4942-bd2c-c2380834cd47 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.132631 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.133273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.133533 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.133802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.134471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.136764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.136764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 16:58:15.136764 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 16:58:15.137936 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.164444 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 559/1114] 10.222.0.58 () {60 vars in 1152 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 16:58:15.168488 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.177904 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cfe02-602b-47c7-844c-e63c36844212 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.239374 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.240080 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.240365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.240642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.241336 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.242343 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.242343 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 16:58:15.242343 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 16:58:15.243568 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.263149 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 556/1115] 10.222.0.58 () {60 vars in 1143 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 16:58:15.267302 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.277983 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38d78-0f35-4669-960c-b3ce7ee69181 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.282436 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.283080 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.283384 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.283659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.284362 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.285361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.285361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 16:58:15.285361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 16:58:15.286236 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.299094 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 560/1116] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 16:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:58:15.302946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.312456 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635561a-0c6a-44f7-8c07-017c32f12b0e admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.316870 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.317711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.317996 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.318268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.318968 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.320007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.320007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 16:58:15.320007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 16:58:15.320887 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcc00-c2c9-4929-8afd-9479b2415f33 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.334264 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 557/1117] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 16:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 16:58:15.338121 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.348163 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950790-367f-4e9b-a002-5686913ec136 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.352825 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.353693 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.353978 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.354369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] PATH_INFO: `/v3/projects/5fc40f2cb4ad4e41b828fb87d5960f1e/users/79f3aeaeb62e4426b826a89c5a31ec13/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.368687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc40f2cb4ad4e41b828fb87d5960f1e, user_id=79f3aeaeb62e4426b826a89c5a31ec13, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.370207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.370207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 16:58:15.370207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 16:58:15.372153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c8a68-639f-47cb-a72b-a00957dfb619 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.384841 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 561/1118] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 16:58:15 2022] PUT /identity/v3/projects/5fc40f2cb4ad4e41b828fb87d5960f1e/users/79f3aeaeb62e4426b826a89c5a31ec13/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:58:15.396295 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc87ad-02e8-4003-a1de-df2c9c5d7a6c None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.396584 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc87ad-02e8-4003-a1de-df2c9c5d7a6c None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.396861 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc87ad-02e8-4003-a1de-df2c9c5d7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.421456 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-1acc87ad-02e8-4003-a1de-df2c9c5d7a6c None None] MFA Rules not processed for user `79f3aeaeb62e4426b826a89c5a31ec13`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:58:15.422630 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-1acc87ad-02e8-4003-a1de-df2c9c5d7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.486261 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 558/1119] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:58:15.501216 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f10e-6cff-4518-b898-d344f158a3b4 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.501497 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f10e-6cff-4518-b898-d344f158a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.501769 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f10e-6cff-4518-b898-d344f158a3b4 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.503293 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 562/1120] 10.222.0.58 () {54 vars in 963 bytes} [Wed May 11 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:58:15.508265 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ee2-76c3-4718-970e-0bdf084d4235 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.508558 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ee2-76c3-4718-970e-0bdf084d4235 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.508841 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ee2-76c3-4718-970e-0bdf084d4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.526731 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c1b22ee2-76c3-4718-970e-0bdf084d4235 None None] MFA Rules not processed for user `24d4c4c8b0c740eeb45cae6aca0cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:58:15.527945 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c1b22ee2-76c3-4718-970e-0bdf084d4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.577521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 559/1121] 10.222.0.58 () {58 vars in 1060 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:58:15.585084 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f10e-6cff-4518-b898-d344f158a3b4 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.596899 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f10e-6cff-4518-b898-d344f158a3b4 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.600340 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24d4c4c8b0c740eeb45cae6aca0cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.600966 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.601246 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.601517 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.609433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.610839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.619173 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 563/1122] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:58:15 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:58:15.654498 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0608-830a-46f6-95a9-d14367416b55 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.654813 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0608-830a-46f6-95a9-d14367416b55 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.655101 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0608-830a-46f6-95a9-d14367416b55 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.656405 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 560/1123] 10.222.0.58 () {52 vars in 829 bytes} [Wed May 11 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:58:15.659940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.719272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b42b0-1ef4-4804-9451-4ea11ac28546 service cinder] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.723860 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.724738 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.725018 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.725297 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] PATH_INFO: `/v3/users/79f3aeaeb62e4426b826a89c5a31ec13` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.726485 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f3aeaeb62e4426b826a89c5a31ec13)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:15.727524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:15.727524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 16:58:15.727524 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 16:58:15.728719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:15.789127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f3aeaeb62e4426b826a89c5a31ec13'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:15.789770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f3aeaeb62e4426b826a89c5a31ec13'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:15.807109 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f3aeaeb62e4426b826a89c5a31ec13'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:15.816877 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f3aeaeb62e4426b826a89c5a31ec13'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:15.817507 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f3aeaeb62e4426b826a89c5a31ec13'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:15.834547 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 564/1124] 10.222.0.58 () {58 vars in 1223 bytes} [Wed May 11 16:58:15 2022] DELETE /identity/v3/users/79f3aeaeb62e4426b826a89c5a31ec13 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:58:15.840419 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.840822 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.841197 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:15.864641 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:58:15.866289 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.926201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 561/1125] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:58:15.936267 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:15.937659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:15.993761 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3dd7-0846-48ad-a5cb-24c9847f5c15 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:15.997916 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:15.998552 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:15.998831 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:15.999102 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:16.007812 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:16.009219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b173-0d0c-4cb1-b6ce-fcf34d8cafac service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:16.018182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 565/1126] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:58:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:58:16.331554 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:58:16.333016 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:58:16.345989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968843b-c124-45b4-9fd4-4aa439b053d0 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:58:16.350712 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:58:16.351651 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:58:16.351938 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:58:16.352218 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] PATH_INFO: `/v3/projects/5fc40f2cb4ad4e41b828fb87d5960f1e` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:58:16.353491 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc40f2cb4ad4e41b828fb87d5960f1e)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:58:16.355074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 16:58:16.355074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 16:58:16.355074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 16:58:16.359448 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:58:16.414836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc40f2cb4ad4e41b828fb87d5960f1e', 'request_id': 'req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:16.424783 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc40f2cb4ad4e41b828fb87d5960f1e', 'request_id': 'req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:16.430840 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc40f2cb4ad4e41b828fb87d5960f1e', 'request_id': 'req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:16.450474 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] The token cache is being invalidate because project 5fc40f2cb4ad4e41b828fb87d5960f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 16:58:16.450754 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:16.451532 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-d0cf46b6-1dc5-4f84-b0d3-46590caff4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 16:58:16.453064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 562/1127] 10.222.0.58 () {58 vars in 1232 bytes} [Wed May 11 16:58:16 2022] DELETE /identity/v3/projects/5fc40f2cb4ad4e41b828fb87d5960f1e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 16:59:40.011265 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:40.011900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:40.011900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:40.013287 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:40.017977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fbe-e985-4bc4-9f02-b433f0e587bc None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:40.018394 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fbe-e985-4bc4-9f02-b433f0e587bc None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:40.018530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fbe-e985-4bc4-9f02-b433f0e587bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:40.081842 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ea3e9fbe-e985-4bc4-9f02-b433f0e587bc None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:40.083005 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ea3e9fbe-e985-4bc4-9f02-b433f0e587bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:40.170556 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:59:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:40.346457 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:40.348097 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:40.434106 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3604da3-3733-41aa-be95-6f65033448ca None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:40.438928 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:40.439585 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:40.439871 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:40.440143 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:40.448006 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:40.449557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85866-2d20-4760-aee0-3744016e0ffc service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:40.458687 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 567/1130] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:59:41.355801 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548378-1425-43df-a481-cc1053d31ea2 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:41.356338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548378-1425-43df-a481-cc1053d31ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:41.356338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548378-1425-43df-a481-cc1053d31ea2 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:41.357711 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:41.362388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128456-4298-427b-ae08-d018601c0725 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:41.362836 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128456-4298-427b-ae08-d018601c0725 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:41.362931 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128456-4298-427b-ae08-d018601c0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:41.381078 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-4a128456-4298-427b-ae08-d018601c0725 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:41.382253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-4a128456-4298-427b-ae08-d018601c0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:41.389993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:59:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:41.543895 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548378-1425-43df-a481-cc1053d31ea2 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:41.556965 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548378-1425-43df-a481-cc1053d31ea2 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:41.561756 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:41.562386 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:41.562692 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:41.562969 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:41.570757 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:41.572383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db886e0-2029-4204-8e70-7412ea5ca38e service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:41.581402 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 565/1133] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:59:45.484319 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de051b-571c-4731-95eb-a0c3af576d1a None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:45.484785 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de051b-571c-4731-95eb-a0c3af576d1a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:45.484880 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de051b-571c-4731-95eb-a0c3af576d1a None None] PATH_INFO: `/v3` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:45.486132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 569/1134] 10.222.0.71 () {54 vars in 925 bytes} [Wed May 11 16:59:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 16:59:45.492088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172e1d-8adb-428f-920b-1dbb456d24fe None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:45.492516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172e1d-8adb-428f-920b-1dbb456d24fe None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:45.492617 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172e1d-8adb-428f-920b-1dbb456d24fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:45.520175 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7f172e1d-8adb-428f-920b-1dbb456d24fe None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:45.521368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7f172e1d-8adb-428f-920b-1dbb456d24fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:45.581046 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 566/1135] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 11 16:59:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:49.568448 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5b2e6-bf51-47bc-a60a-260b46776143 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:49.569001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5b2e6-bf51-47bc-a60a-260b46776143 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:49.569001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5b2e6-bf51-47bc-a60a-260b46776143 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:49.570470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 570/1136] 10.222.0.58 () {54 vars in 960 bytes} [Wed May 11 16:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:49.575640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772299-c32d-4a7c-931a-a5049a4903b6 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:49.576074 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772299-c32d-4a7c-931a-a5049a4903b6 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:49.576201 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772299-c32d-4a7c-931a-a5049a4903b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:49.593697 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8a772299-c32d-4a7c-931a-a5049a4903b6 None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:49.594877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8a772299-c32d-4a7c-931a-a5049a4903b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:49.603596 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 567/1137] 10.222.0.58 () {58 vars in 1057 bytes} [Wed May 11 16:59:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:49.611713 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5b2e6-bf51-47bc-a60a-260b46776143 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:49.625387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5b2e6-bf51-47bc-a60a-260b46776143 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:49.630164 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:49.630780 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:49.631059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:49.631332 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:49.639210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:49.640812 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e9cdf-226f-4d88-86dc-bd5370727715 service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:49.649941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 571/1138] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:49 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:59:52.875089 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d457a-8df5-4126-8c3a-246e3625c994 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:52.875699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d457a-8df5-4126-8c3a-246e3625c994 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:52.875699 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d457a-8df5-4126-8c3a-246e3625c994 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:52.877047 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:52.881822 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee92a-f75d-4c1a-94b4-562f781d8f57 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:52.882283 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee92a-f75d-4c1a-94b4-562f781d8f57 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:52.882388 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee92a-f75d-4c1a-94b4-562f781d8f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:52.899802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-6b0ee92a-f75d-4c1a-94b4-562f781d8f57 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:52.900982 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-6b0ee92a-f75d-4c1a-94b4-562f781d8f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:52.909225 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:59:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 16:59:53.060010 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d457a-8df5-4126-8c3a-246e3625c994 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:53.073786 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d457a-8df5-4126-8c3a-246e3625c994 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:53.078690 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:53.079312 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:53.079616 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:53.079885 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:53.087866 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:53.089436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d11ab-a433-4d13-8126-7521d4f3f65a service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:53.099162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 569/1141] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:59:53.974392 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f038cd-c53c-4150-82f7-5e52bd20250f None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:53.974941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f038cd-c53c-4150-82f7-5e52bd20250f None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:53.974941 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f038cd-c53c-4150-82f7-5e52bd20250f None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:53.976342 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 16:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:53.981722 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21538503-0692-4661-ab08-e5151b6e71e2 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:53.982165 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21538503-0692-4661-ab08-e5151b6e71e2 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:53.982268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21538503-0692-4661-ab08-e5151b6e71e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:54.000371 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-21538503-0692-4661-ab08-e5151b6e71e2 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:54.001715 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-21538503-0692-4661-ab08-e5151b6e71e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:54.009484 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 16:59:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:54.160346 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f038cd-c53c-4150-82f7-5e52bd20250f None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:54.173910 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f038cd-c53c-4150-82f7-5e52bd20250f None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:54.179029 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:54.179695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:54.179977 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:54.180251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:54.189175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:54.190742 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b042-4dba-4151-9a3d-b8d546a82ae9 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:54.199805 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 574/1144] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 16:59:58.887900 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:58.888464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:58.888464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:58.889816 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 16:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 16:59:58.894814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e690e-52ef-4b1f-9cbf-18ab30924b67 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:58.895233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e690e-52ef-4b1f-9cbf-18ab30924b67 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:58.895377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e690e-52ef-4b1f-9cbf-18ab30924b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:58.912680 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-331e690e-52ef-4b1f-9cbf-18ab30924b67 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 16:59:58.913847 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-331e690e-52ef-4b1f-9cbf-18ab30924b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:58.921471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 16:59:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 16:59:58.962278 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 16:59:58.963958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 16:59:59.017963 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bfa2-46f8-4e55-bce5-6cf461f9940f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 16:59:59.021385 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 16:59:59.022041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 16:59:59.022299 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 16:59:59.022572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 16:59:59.031061 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 16:59:59.032508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281106-faab-4069-bec3-23c79f2a040f service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 16:59:59.041351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 572/1147] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 16:59:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:00:01.277650 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6d5b-71c5-444c-bf2a-8afa93cd68ab None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:01.278223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6d5b-71c5-444c-bf2a-8afa93cd68ab None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:01.278223 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6d5b-71c5-444c-bf2a-8afa93cd68ab None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:01.279567 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 17:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:00:01.284669 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5836ec-677f-4e81-8ffb-db4424bcde1f None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:01.285073 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5836ec-677f-4e81-8ffb-db4424bcde1f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:01.285227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5836ec-677f-4e81-8ffb-db4424bcde1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:01.304188 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ff5836ec-677f-4e81-8ffb-db4424bcde1f None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:00:01.305377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ff5836ec-677f-4e81-8ffb-db4424bcde1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:00:01.313018 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 17:00:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:00:01.348724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6d5b-71c5-444c-bf2a-8afa93cd68ab None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:00:01.359491 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6d5b-71c5-444c-bf2a-8afa93cd68ab None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:00:01.362903 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:00:01.363558 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:01.363840 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:01.364112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:01.372574 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:00:01.373967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85f503-9d9d-4ebc-a910-7e10410fa27f service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:00:01.382974 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 577/1150] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:00:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:00:05.319787 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:05.320360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:05.320360 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:05.321695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 17:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:00:05.327318 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3986-0245-4439-bde0-6221b076809a None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:05.327773 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3986-0245-4439-bde0-6221b076809a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:05.327897 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3986-0245-4439-bde0-6221b076809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:05.345984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-d49c3986-0245-4439-bde0-6221b076809a None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:00:05.347546 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-d49c3986-0245-4439-bde0-6221b076809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:00:05.355289 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 17:00:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:00:05.627495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:00:05.629175 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:00:05.684406 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99943-e531-43f8-bf5e-9e10d2fc6c7e None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:00:05.688024 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24d4c4c8b0c740eeb45cae6aca0cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:00:05.688676 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:05.688956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:05.689227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:05.698031 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:00:05.700099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad59d4-13b0-42fd-a8c5-4129984fcd9b service cinder] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:00:05.708944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 575/1153] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:00:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:00:08.016576 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:08.017179 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:08.017179 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:08.018479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 17:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:00:08.023732 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72298c2-b506-41d7-996f-c8be6b6e2c8b None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:08.024162 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72298c2-b506-41d7-996f-c8be6b6e2c8b None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:08.024282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72298c2-b506-41d7-996f-c8be6b6e2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:08.042092 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-d72298c2-b506-41d7-996f-c8be6b6e2c8b None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:00:08.043957 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-d72298c2-b506-41d7-996f-c8be6b6e2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:00:08.051612 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 17:00:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:00:08.321234 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:00:08.322927 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:00:08.336408 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f565cc0-caea-4527-808a-8fa986f9cecf None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:00:08.340662 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24d4c4c8b0c740eeb45cae6aca0cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:00:08.341291 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:00:08.341567 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:00:08.341838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:00:08.350797 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:00:08.352232 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987e8e-9a6b-476e-9ef5-76d5f9c8757f service cinder] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:00:08.361472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 580/1156] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:00:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:01:30.173216 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11f91-05ae-442b-bcc5-efa9c3c06e36 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.173868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11f91-05ae-442b-bcc5-efa9c3c06e36 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.173868 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11f91-05ae-442b-bcc5-efa9c3c06e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.178707 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbfc8-ae47-4054-b82c-a4a8630eec8e None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.179187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbfc8-ae47-4054-b82c-a4a8630eec8e None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.179290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbfc8-ae47-4054-b82c-a4a8630eec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.192877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-7cc11f91-05ae-442b-bcc5-efa9c3c06e36 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.194204 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-7cc11f91-05ae-442b-bcc5-efa9c3c06e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.199134 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9edbbfc8-ae47-4054-b82c-a4a8630eec8e None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.200308 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9edbbfc8-ae47-4054-b82c-a4a8630eec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.202508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 577/1157] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:30.208023 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 581/1158] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:30.212541 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.213400 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.213674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.217489 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.217802 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.218079 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.231659 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.233028 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.235309 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.236472 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.240928 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 578/1159] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:30.248059 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 582/1160] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:30.248227 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.249052 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.255365 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff881b-77f9-4fe6-b4ab-78001f118d41 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.257917 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b1b17-d55d-4a4a-8475-81dc5d259e53 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.260547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.261187 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.261464 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.261735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] PATH_INFO: `/v3/domains` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.262443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86709) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 17:01:30.262742 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.263380 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.264028 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.264312 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.264593 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.264730 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.265303 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86710) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 17:01:30.265610 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.266604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 17:01:30.266604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 17:01:30.266604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 17:01:30.267517 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.277584 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 579/1161] 10.222.0.58 () {58 vars in 1152 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 17:01:30.279260 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 583/1162] 10.222.0.58 () {58 vars in 1152 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 17:01:30.285414 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.286712 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.295663 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2469a6-6b43-43e8-a659-6d9c8b4c91cd admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.296057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0ffa3-7442-4710-9c83-a143e2ca9b26 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.300134 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.300496 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.300767 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.301047 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.301154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.301421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.301535 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.301695 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.302130 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.302367 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.303308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 17:01:30.303308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 17:01:30.303308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 17:01:30.304290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.304504 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.341288 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 580/1163] 10.222.0.58 () {60 vars in 1152 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 17:01:30.341696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 584/1164] 10.222.0.58 () {60 vars in 1152 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 17:01:30.345642 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.345798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.403421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627624-41f4-48c7-a6f2-c7d734766b6d admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.403893 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa433b-934c-4250-81d9-9f86107d5b97 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.408139 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.408786 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.408931 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.409066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.409337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.409456 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.409721 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.409996 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.410097 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.410710 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.411766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: WARNING py.warnings [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 17:01:30.411766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: warnings.warn(msg) May 11 17:01:30.411766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: May 11 17:01:30.412059 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.413003 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.431983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 581/1165] 10.222.0.58 () {60 vars in 1143 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 17:01:30.435065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 585/1166] 10.222.0.58 () {60 vars in 1143 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 17:01:30.436274 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.438584 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.445751 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf9ceb-fb26-436c-b7f9-d4ff3a51deb5 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.448187 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45578b-4f00-402c-9195-93b706dd74f2 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.450814 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.451549 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.451790 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.452042 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.452747 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.452867 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.453405 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.453684 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.453958 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.454354 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.454663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.456258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.466045 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 586/1167] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 17:01:30.469052 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 582/1168] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:30.469971 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.470090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.479887 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05e85-6dcc-46c2-86c5-971cf4284eb2 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.481576 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4f425-d060-4298-a84c-ce14cb22c5f8 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.484509 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.485158 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.485441 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.485719 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.486132 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.486425 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.486775 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.487052 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.487323 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.488055 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.488178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.489617 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.498771 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 583/1169] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:30.502976 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 587/1170] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:30.503127 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.504127 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.513217 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152c97-cdd0-454f-bbca-d9bd490a1d89 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.514065 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b299-ccac-4961-8f95-3d1ee37e8054 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.517827 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.518677 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.518828 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.518989 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.519263 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] PATH_INFO: `/v3/projects/0719ca3797ea4697b9d6512af2642e6d/users/ce514e3a7aab4a0fb0d25dee5161d4d1/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.519589 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.519874 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.520151 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] PATH_INFO: `/v3/projects/0bbde5d914044216901ece19cbcc322a/users/acbc6895432e44ada826483a70fa5743/roles/2b985b7fd08b44d0b2739997130a8251` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.533206 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0719ca3797ea4697b9d6512af2642e6d, user_id=ce514e3a7aab4a0fb0d25dee5161d4d1, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.534238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: WARNING py.warnings [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 17:01:30.534238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: warnings.warn(msg) May 11 17:01:30.534238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: May 11 17:01:30.534509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbde5d914044216901ece19cbcc322a, user_id=acbc6895432e44ada826483a70fa5743, role_id=2b985b7fd08b44d0b2739997130a8251)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.536178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967594-c601-4665-8a5f-329d2588fc9a admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.536921 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7083ac-de79-4c57-8c77-a343ec756b23 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.549007 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 584/1171] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:30 2022] PUT /identity/v3/projects/0719ca3797ea4697b9d6512af2642e6d/users/ce514e3a7aab4a0fb0d25dee5161d4d1/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 17:01:30.549720 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 588/1172] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:30 2022] PUT /identity/v3/projects/0bbde5d914044216901ece19cbcc322a/users/acbc6895432e44ada826483a70fa5743/roles/2b985b7fd08b44d0b2739997130a8251 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:01:30.554192 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.554483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.554604 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.554754 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.554863 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.555075 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.571490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.573273 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.573403 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] MFA Rules not processed for user `20792e246db94bf6a86a88130fe78b74`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:30.574723 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.628622 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 585/1173] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:30.634999 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 589/1174] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:30.638944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.644575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:30.645937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:30.690444 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3305dc-d6bf-40a9-9739-559401d37755 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.693946 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.694587 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.694867 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.695140 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.704052 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.705483 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc3908-5bba-495d-93bf-aaf3ceaa7820 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.709097 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efceac-69c2-48e7-b159-ba74b13f9c41 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:30.713421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:30.714049 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:30.714327 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:30.714600 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:30.714976 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 586/1175] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:01:30.723642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:30.725064 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:30.734660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 590/1176] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:01:35.787947 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:35.788438 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:35.788687 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:35.823277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:35.824435 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:35.915507 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 587/1177] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:35 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:35.918387 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:35.930011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0bd9-cf08-4480-a186-d07f3c3e456b service neutron] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:35.935706 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:35.936694 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:35.937096 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:35.937467 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] PATH_INFO: `/v3/projects` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:35.938280 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:35.940369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:35.979170 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 591/1178] 10.222.0.58 () {60 vars in 1152 bytes} [Wed May 11 17:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 17:01:35.983064 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:35.999027 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515cc5-60fe-47e5-a036-cecac94c8981 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.079377 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.080449 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.080741 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.081019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] PATH_INFO: `/v3/users` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.081744 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.083769 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.122421 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 588/1179] 10.222.0.58 () {60 vars in 1143 bytes} [Wed May 11 17:01:35 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 17:01:36.124070 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.137477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c5ef-e71d-4c0a-99df-0298b37ce496 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.148960 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.149780 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.150705 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.151175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.152104 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.153878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.185522 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 592/1180] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:36.187721 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.202755 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29a52-0b1c-4849-8f0d-428cb05b0135 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.208849 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.210637 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.211106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.211605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] PATH_INFO: `/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129/users/b079ab6b0a344280969fcf70d6f30bdd/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.232632 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66089a9d8b4d8d93df8f8bf7517129, user_id=b079ab6b0a344280969fcf70d6f30bdd, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.238371 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.264210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 589/1181] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:36 2022] PUT /identity/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129/users/b079ab6b0a344280969fcf70d6f30bdd/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:01:36.265051 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.276083 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe54fa-872b-47fc-9313-051d9389140a admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.356765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.357967 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.358443 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.358928 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] PATH_INFO: `/v3/roles` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.359901 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.361906 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272a36d-a254-48cd-8095-982708a11582 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.377359 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 593/1182] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:36.377958 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.389451 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588219a-addd-484c-98f3-59cb10f35d5d admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.395277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.396238 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] REQUEST_METHOD: `PUT` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.396530 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.397432 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] PATH_INFO: `/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129/users/b079ab6b0a344280969fcf70d6f30bdd/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.399805 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66089a9d8b4d8d93df8f8bf7517129, user_id=b079ab6b0a344280969fcf70d6f30bdd, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.402882 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.422381 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 590/1183] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:36 2022] PUT /identity/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129/users/b079ab6b0a344280969fcf70d6f30bdd/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 17:01:36.490696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.490978 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.491251 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.528271 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] MFA Rules not processed for user `acbc6895432e44ada826483a70fa5743`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:36.529632 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:36.623511 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 594/1184] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:36 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:36.627583 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.733308 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c77e-1289-4c5c-9ef3-b0982151f378 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.739183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.739949 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.740224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.740503 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] PATH_INFO: `/v3/projects` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.741219 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.743286 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.782186 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 591/1185] 10.222.0.58 () {60 vars in 1152 bytes} [Wed May 11 17:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 17:01:36.784138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.814479 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a8056-d3c6-47b9-b887-df21464a8033 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.904410 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.905110 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.905397 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.905681 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] PATH_INFO: `/v3/users` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.906421 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.913688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.950269 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 595/1186] 10.222.0.58 () {60 vars in 1143 bytes} [Wed May 11 17:01:36 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 17:01:36.954887 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:36.967761 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10c40-256d-4fac-8a50-c5697f45b66f admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:36.973602 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:36.974374 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:36.974725 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:36.975239 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:36.976090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:36.977908 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:36.995490 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 592/1187] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:36.996325 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:37.006397 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2caf-2a6d-4691-a35d-5cd4aa18b3bb admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:37.012937 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:37.013990 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:37.014341 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:37.014679 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] PATH_INFO: `/v3/projects/4a1c2152000544158a6ae73d54b2e9ca/users/d6d64a7b596d42eaa1853480433edec1/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:37.035602 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1c2152000544158a6ae73d54b2e9ca, user_id=d6d64a7b596d42eaa1853480433edec1, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:37.038975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:37.065811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 596/1188] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:36 2022] PUT /identity/v3/projects/4a1c2152000544158a6ae73d54b2e9ca/users/d6d64a7b596d42eaa1853480433edec1/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 17:01:37.067252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:37.077715 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518780-2c7b-4a47-9971-15800a6b42c2 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:37.153026 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:37.153716 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:37.153999 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:37.154267 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] PATH_INFO: `/v3/roles` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:37.155173 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:37.157180 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f795a-85de-4273-81fb-b703c8994580 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:37.170282 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 593/1189] 10.222.0.58 () {58 vars in 1121 bytes} [Wed May 11 17:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 17:01:37.174900 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:37.188500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5f853-d4c7-49c1-9c7c-2eefde7263e7 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:37.194081 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:37.196182 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:37.196704 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:37.197224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] PATH_INFO: `/v3/projects/4a1c2152000544158a6ae73d54b2e9ca/users/d6d64a7b596d42eaa1853480433edec1/roles/df86ea59d76740488f867f6211ccfa28` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:37.202459 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1c2152000544158a6ae73d54b2e9ca, user_id=d6d64a7b596d42eaa1853480433edec1, role_id=df86ea59d76740488f867f6211ccfa28)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:37.205998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:37.226343 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 597/1190] 10.222.0.58 () {60 vars in 1482 bytes} [Wed May 11 17:01:37 2022] PUT /identity/v3/projects/4a1c2152000544158a6ae73d54b2e9ca/users/d6d64a7b596d42eaa1853480433edec1/roles/df86ea59d76740488f867f6211ccfa28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:01:42.809844 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e54e9-7d52-40d2-8a2c-1996d3e35899 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:42.810337 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e54e9-7d52-40d2-8a2c-1996d3e35899 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:42.811019 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e54e9-7d52-40d2-8a2c-1996d3e35899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:42.845390 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-0f7e54e9-7d52-40d2-8a2c-1996d3e35899 None None] MFA Rules not processed for user `b079ab6b0a344280969fcf70d6f30bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:42.846682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0f7e54e9-7d52-40d2-8a2c-1996d3e35899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:42.949252 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 594/1191] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:42 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:42.966413 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:42.968884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:43.113391 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d61d0-bf27-4ca9-a402-4600da5cfeaa admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:43.126641 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e72d051cbc4630a7e0e197a6df5369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:43.127450 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:43.128057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:43.128418 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:43.261648 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:43.266739 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:43.283826 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 598/1192] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:42 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:01:44.235652 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30fcea-2990-4c0e-b2d6-0f076cca9639 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:44.236164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30fcea-2990-4c0e-b2d6-0f076cca9639 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:44.236164 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30fcea-2990-4c0e-b2d6-0f076cca9639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:44.273368 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-2e30fcea-2990-4c0e-b2d6-0f076cca9639 None None] MFA Rules not processed for user `d6d64a7b596d42eaa1853480433edec1`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:44.275447 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-2e30fcea-2990-4c0e-b2d6-0f076cca9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:44.376940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:44.378910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 595/1193] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:44 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:44.388101 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884fad-ec42-4dab-8737-ca6473194d11 service glance] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:44.392659 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e72d051cbc4630a7e0e197a6df5369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:44.393440 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:44.393975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:44.394644 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:44.467905 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:44.469449 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d2efe-56cb-4631-ae82-6833ecee1a85 service glance] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:44.479649 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 599/1194] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:44 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:01:52.647696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f432f-efef-44d8-96f2-3cf0c0fbfa87 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:52.648506 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f432f-efef-44d8-96f2-3cf0c0fbfa87 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:52.648506 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f432f-efef-44d8-96f2-3cf0c0fbfa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:52.667041 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-8a6f432f-efef-44d8-96f2-3cf0c0fbfa87 None None] MFA Rules not processed for user `acbc6895432e44ada826483a70fa5743`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:52.668268 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-8a6f432f-efef-44d8-96f2-3cf0c0fbfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:52.675571 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 596/1195] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:01:52 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:52.952060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1834-c580-4424-b3f2-1d95da7bf345 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:52.952584 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1834-c580-4424-b3f2-1d95da7bf345 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:52.952584 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1834-c580-4424-b3f2-1d95da7bf345 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:52.953969 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 600/1196] 10.222.0.58 () {54 vars in 961 bytes} [Wed May 11 17:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:52.959008 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc3a-aea2-4c9f-a9be-2a0ba79256f9 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:52.959420 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc3a-aea2-4c9f-a9be-2a0ba79256f9 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:52.959778 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc3a-aea2-4c9f-a9be-2a0ba79256f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:52.992091 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-c8b8fc3a-aea2-4c9f-a9be-2a0ba79256f9 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:52.994001 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-c8b8fc3a-aea2-4c9f-a9be-2a0ba79256f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:53.056372 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 597/1197] 10.222.0.58 () {58 vars in 1058 bytes} [Wed May 11 17:01:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:53.061948 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.062233 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.062500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.063993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 601/1198] 10.222.0.58 () {54 vars in 912 bytes} [Wed May 11 17:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:53.068696 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b062-799b-445d-a9f5-0ca35278cf58 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.068988 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b062-799b-445d-a9f5-0ca35278cf58 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.069269 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b062-799b-445d-a9f5-0ca35278cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.087434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-fff8b062-799b-445d-a9f5-0ca35278cf58 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:53.088682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-fff8b062-799b-445d-a9f5-0ca35278cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:53.097138 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 598/1199] 10.222.0.58 () {58 vars in 1009 bytes} [Wed May 11 17:01:53 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:53.109016 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:53.110791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:53.124700 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70344f2-be39-4dc5-8897-2c612e3079e7 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:53.128445 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e72d051cbc4630a7e0e197a6df5369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:53.129160 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.129518 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.129857 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.141279 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:53.142711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863d62-1c25-46fd-b5c5-920ab62b51e9 service glance] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:53.153259 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 602/1200] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:53 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:01:53.507656 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43978-98fd-40ce-bf0e-4af5f8e670ce None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.507950 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43978-98fd-40ce-bf0e-4af5f8e670ce None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.508225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43978-98fd-40ce-bf0e-4af5f8e670ce None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.509615 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 599/1201] 10.222.0.58 () {54 vars in 912 bytes} [Wed May 11 17:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:53.514562 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfe6c-1c8e-4160-8985-8255901db505 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.514847 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfe6c-1c8e-4160-8985-8255901db505 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.515122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfe6c-1c8e-4160-8985-8255901db505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.532765 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-dd3dfe6c-1c8e-4160-8985-8255901db505 None None] MFA Rules not processed for user `5f1f023aee544e4fa1c31808f7b3ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:53.533935 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-dd3dfe6c-1c8e-4160-8985-8255901db505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:53.589902 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 603/1202] 10.222.0.58 () {58 vars in 1009 bytes} [Wed May 11 17:01:53 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:53.601029 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43978-98fd-40ce-bf0e-4af5f8e670ce None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:53.612323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43978-98fd-40ce-bf0e-4af5f8e670ce None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:53.615884 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:53.616508 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:53.616784 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:53.617055 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:53.624639 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:53.626537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca312bfe-7154-4ddc-85f5-c59ad9a797c7 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:53.636628 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 600/1203] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:53 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:01:54.051759 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47ab3-67c9-4dc5-9902-339b0dd9d607 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.052214 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47ab3-67c9-4dc5-9902-339b0dd9d607 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.052349 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47ab3-67c9-4dc5-9902-339b0dd9d607 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.053995 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 604/1204] 10.222.0.58 () {54 vars in 961 bytes} [Wed May 11 17:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:54.061068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e29b7-eea1-46ec-86bb-eaac40dc76fd None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.061970 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e29b7-eea1-46ec-86bb-eaac40dc76fd None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.062429 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e29b7-eea1-46ec-86bb-eaac40dc76fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.071155 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e03e-fae2-48cc-8b7b-e4fa1fac9d18 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.072060 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e03e-fae2-48cc-8b7b-e4fa1fac9d18 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.072433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e03e-fae2-48cc-8b7b-e4fa1fac9d18 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.074145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 605/1205] 10.222.0.58 () {54 vars in 960 bytes} [Wed May 11 17:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:54.080837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.081201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.081556 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.091803 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-ec8e29b7-eea1-46ec-86bb-eaac40dc76fd None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:54.094183 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-ec8e29b7-eea1-46ec-86bb-eaac40dc76fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:54.105273 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 601/1206] 10.222.0.58 () {58 vars in 1058 bytes} [Wed May 11 17:01:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:54.107792 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] MFA Rules not processed for user `02582a7f42294aa883540235c867979a`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:54.109057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:54.112056 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdc3d-9e79-4986-aecb-b0cc443b53cf None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.112600 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdc3d-9e79-4986-aecb-b0cc443b53cf None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.113070 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdc3d-9e79-4986-aecb-b0cc443b53cf None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.114956 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 602/1207] 10.222.0.58 () {54 vars in 912 bytes} [Wed May 11 17:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:01:54.120344 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.120896 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.121349 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.144584 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:01:54.146103 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:54.168182 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 603/1208] 10.222.0.58 () {58 vars in 1009 bytes} [Wed May 11 17:01:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:01:54.180258 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:54.191682 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eca6c-5295-4fc1-b6e0-8247bf86a8c3 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:54.198202 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:54.199101 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.199476 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.200133 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.200976 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 606/1209] 10.222.0.58 () {58 vars in 1057 bytes} [Wed May 11 17:01:54 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:01:54.202224 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:01:54.213836 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:54.214147 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b555ee-3cfc-4540-a657-6882bb7a434d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:01:54.216143 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d6d69-dcd1-4f66-ae63-35c429ce30fd service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:54.220842 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:01:54.221495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:01:54.221834 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:01:54.222119 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:01:54.224015 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:01:54.228225 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 604/1210] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:01:54.238239 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:01:54.240274 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:01:54.252378 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 607/1211] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:01:54 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:02:04.067879 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2b8a-0d79-42aa-bee2-f588955034d4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:04.068431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2b8a-0d79-42aa-bee2-f588955034d4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:04.068431 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2b8a-0d79-42aa-bee2-f588955034d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:04.088249 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-385e2b8a-0d79-42aa-bee2-f588955034d4 None None] MFA Rules not processed for user `5f1f023aee544e4fa1c31808f7b3ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:02:04.089626 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-385e2b8a-0d79-42aa-bee2-f588955034d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:02:04.097967 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 605/1212] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 11 17:02:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:02:04.109882 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:02:04.119570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c9f1-04bf-495d-9a2a-b187197c35df service placement] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:02:04.123069 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:02:04.123725 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:04.124006 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:04.124277 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:04.130984 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:02:04.132477 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e746-f47b-40d0-977f-166880d4b8f3 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:02:04.140741 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 608/1213] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:02:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:02:04.967076 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a4e-8ec6-43f3-93f0-8243aa7c236f None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:04.967397 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a4e-8ec6-43f3-93f0-8243aa7c236f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:04.967661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6a4e-8ec6-43f3-93f0-8243aa7c236f None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:04.969193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 606/1214] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 17:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:02:05.005710 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a1c0-f197-417a-b7d1-f4305c4668a4 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:05.006011 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a1c0-f197-417a-b7d1-f4305c4668a4 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:05.006290 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664a1c0-f197-417a-b7d1-f4305c4668a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:05.027975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-0664a1c0-f197-417a-b7d1-f4305c4668a4 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:02:05.029181 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-0664a1c0-f197-417a-b7d1-f4305c4668a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:02:05.039607 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 609/1215] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 17:02:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:02:05.061434 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6a4e-8ec6-43f3-93f0-8243aa7c236f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:02:05.079087 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6a4e-8ec6-43f3-93f0-8243aa7c236f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:02:05.085657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:02:05.086303 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:05.086585 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:05.087555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:05.096392 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:02:05.097977 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd317ed-b454-4dd8-95e1-ecae8c463e2a service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:02:05.114411 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 607/1216] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:02:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:02:11.859334 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650be-c36f-4e55-8b3a-39ba6b6618f2 None None] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:11.859851 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650be-c36f-4e55-8b3a-39ba6b6618f2 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:11.859932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650be-c36f-4e55-8b3a-39ba6b6618f2 None None] PATH_INFO: `/` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:11.861447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 610/1217] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 17:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:02:11.869138 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:11.869657 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:11.869736 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:11.890304 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:02:11.891521 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:02:11.900497 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 608/1218] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 17:02:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:02:11.913878 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3650be-c36f-4e55-8b3a-39ba6b6618f2 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:02:11.928091 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3650be-c36f-4e55-8b3a-39ba6b6618f2 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:02:11.934022 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:02:11.934663 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:11.934945 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:11.935220 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:11.944559 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:02:11.946167 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da65a1-6252-48f6-b967-2c23dc6b1a1e service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:02:11.956012 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 611/1219] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:02:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:02:21.799222 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:02:21.809002 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be9d36-a23b-454e-be9b-06bee9383bc4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:02:21.812529 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:02:21.813212 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:21.813499 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:21.813776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:21.823338 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:02:21.824792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89264-79d4-4908-98ec-47bed0a02b24 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:02:21.834088 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 609/1220] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:02:21 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:02:41.155299 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:41.155828 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:41.155924 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:41.173122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:02:41.174285 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:02:41.181796 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 612/1221] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:02:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:02:41.468890 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932b8e-9c56-4b69-ae31-d130260cb1c8 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:41.469440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932b8e-9c56-4b69-ae31-d130260cb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:41.469440 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932b8e-9c56-4b69-ae31-d130260cb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:41.487327 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-da932b8e-9c56-4b69-ae31-d130260cb1c8 None None] MFA Rules not processed for user `5f1f023aee544e4fa1c31808f7b3ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:02:41.488544 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-da932b8e-9c56-4b69-ae31-d130260cb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:02:41.494819 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 610/1222] 10.222.0.58 () {58 vars in 1009 bytes} [Wed May 11 17:02:41 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:02:41.505673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:02:41.514795 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae0dee-1976-49a2-aec2-cc21fbdd8f7d None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:02:41.518212 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:02:41.518838 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:02:41.519112 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:02:41.519400 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:02:41.526468 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:02:41.527912 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1e63f-0618-486f-b8f8-c04e26a01fd7 service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:02:41.535218 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 613/1223] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:02:41 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:03:04.361566 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ce9e-f63f-4499-a974-8a87d2f93f7e None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:04.362033 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ce9e-f63f-4499-a974-8a87d2f93f7e None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:04.362135 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ce9e-f63f-4499-a974-8a87d2f93f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:04.379276 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-0770ce9e-f63f-4499-a974-8a87d2f93f7e None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:03:04.380466 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0770ce9e-f63f-4499-a974-8a87d2f93f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:03:04.387066 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 611/1224] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:03:04 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:03:18.796642 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b92-e2a3-4a37-92d4-e2ac1e53dd47 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:18.797201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b92-e2a3-4a37-92d4-e2ac1e53dd47 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:18.797201 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b92-e2a3-4a37-92d4-e2ac1e53dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:18.815117 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-486c1b92-e2a3-4a37-92d4-e2ac1e53dd47 None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:03:18.816339 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-486c1b92-e2a3-4a37-92d4-e2ac1e53dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:03:18.823077 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 614/1225] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:03:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:03:37.751598 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531482-39ff-400f-81f3-b085bbc86a72 None None] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:37.752144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531482-39ff-400f-81f3-b085bbc86a72 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:37.752144 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531482-39ff-400f-81f3-b085bbc86a72 None None] PATH_INFO: `/` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:37.753546 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 612/1226] 10.222.0.58 () {54 vars in 921 bytes} [Wed May 11 17:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 17:03:37.760619 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:37.761136 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:37.761215 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:37.800470 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] MFA Rules not processed for user `68d73b4a0e1646a19c1c70479a98a736`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:03:37.801294 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:03:37.811940 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 615/1227] 10.222.0.58 () {58 vars in 1018 bytes} [Wed May 11 17:03:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:03:37.828373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531482-39ff-400f-81f3-b085bbc86a72 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:03:37.843266 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531482-39ff-400f-81f3-b085bbc86a72 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:03:37.849306 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:03:37.850150 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:37.850605 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:37.850886 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:37.860037 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:03:37.861644 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:03:37.878203 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 613/1228] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:03:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 17:03:52.084814 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:03:52.162369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90b36-3357-4c3e-a294-a5321673b50a None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:03:52.167321 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:03:52.168353 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:52.168705 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:52.168985 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] PATH_INFO: `/v3/users/acbc6895432e44ada826483a70fa5743` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:52.170175 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbc6895432e44ada826483a70fa5743)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:03:52.172471 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:03:52.223013 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbc6895432e44ada826483a70fa5743'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.223696 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbc6895432e44ada826483a70fa5743'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.237200 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbc6895432e44ada826483a70fa5743'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.245620 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbc6895432e44ada826483a70fa5743'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.246242 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbc6895432e44ada826483a70fa5743'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.259273 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 616/1229] 10.222.0.58 () {58 vars in 1223 bytes} [Wed May 11 17:03:52 2022] DELETE /identity/v3/users/acbc6895432e44ada826483a70fa5743 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:03:52.445556 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:03:52.468538 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2312-76a6-46eb-b5aa-6104d4cc91f4 service nova] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:03:52.533009 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:03:52.533943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:52.534223 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:52.534531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] PATH_INFO: `/v3/projects/0bbde5d914044216901ece19cbcc322a` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:52.535812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbde5d914044216901ece19cbcc322a)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:03:52.537847 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:03:52.588152 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbde5d914044216901ece19cbcc322a', 'request_id': 'req-e9eb6e3d-cec8-46b8-bd30-50208634c102'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.597057 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbde5d914044216901ece19cbcc322a', 'request_id': 'req-e9eb6e3d-cec8-46b8-bd30-50208634c102'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.603195 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbde5d914044216901ece19cbcc322a', 'request_id': 'req-e9eb6e3d-cec8-46b8-bd30-50208634c102'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.614215 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] The token cache is being invalidate because project 0bbde5d914044216901ece19cbcc322a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 17:03:52.614516 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.615141 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.616695 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 614/1230] 10.222.0.58 () {58 vars in 1232 bytes} [Wed May 11 17:03:52 2022] DELETE /identity/v3/projects/0bbde5d914044216901ece19cbcc322a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:03:52.621378 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:03:52.622895 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:03:52.637545 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3a43-2cd2-407c-bb59-c2a3dbc89356 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:03:52.700811 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:03:52.701715 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:52.702138 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:52.702360 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] PATH_INFO: `/v3/users/d6d64a7b596d42eaa1853480433edec1` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:52.703557 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d64a7b596d42eaa1853480433edec1)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:03:52.705461 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:03:52.754544 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d64a7b596d42eaa1853480433edec1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.755550 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d64a7b596d42eaa1853480433edec1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.768433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d64a7b596d42eaa1853480433edec1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.778735 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d64a7b596d42eaa1853480433edec1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.779603 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-4c3ad556-7c09-498c-befc-686156937e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d64a7b596d42eaa1853480433edec1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:52.794422 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 617/1231] 10.222.0.58 () {58 vars in 1223 bytes} [Wed May 11 17:03:52 2022] DELETE /identity/v3/users/d6d64a7b596d42eaa1853480433edec1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 17:03:52.979436 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:03:52.981193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:03:52.994772 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e3d-cec8-46b8-bd30-50208634c102 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:03:53.058537 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:03:53.059621 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:03:53.059983 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:03:53.060210 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] PATH_INFO: `/v3/projects/4a1c2152000544158a6ae73d54b2e9ca` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:03:53.061519 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1c2152000544158a6ae73d54b2e9ca)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:03:53.063674 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:03:53.113328 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1c2152000544158a6ae73d54b2e9ca', 'request_id': 'req-1f9e116a-cb23-4374-8636-91476ab2bf03'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:53.120776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1c2152000544158a6ae73d54b2e9ca', 'request_id': 'req-1f9e116a-cb23-4374-8636-91476ab2bf03'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:53.126126 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1c2152000544158a6ae73d54b2e9ca', 'request_id': 'req-1f9e116a-cb23-4374-8636-91476ab2bf03'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:53.138147 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] The token cache is being invalidate because project 4a1c2152000544158a6ae73d54b2e9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 17:03:53.138460 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:53.139211 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:03:53.141203 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 615/1232] 10.222.0.58 () {58 vars in 1232 bytes} [Wed May 11 17:03:52 2022] DELETE /identity/v3/projects/4a1c2152000544158a6ae73d54b2e9ca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:04:18.388368 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] REQUEST_METHOD: `POST` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:04:18.388873 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:04:18.389001 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:04:18.408154 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.auth.core [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86710) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:04:18.409358 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:04:18.463564 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 618/1233] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:04:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:04:31.027495 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:04:31.028914 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:04:31.091151 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e116a-cb23-4374-8636-91476ab2bf03 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:04:31.094590 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:04:31.095224 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:04:31.095534 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:04:31.095809 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:04:31.097531 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:04:31.155937 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:04:31.157351 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78217-ab03-4a2d-bc2e-4b4d2f128d3f service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:04:31.166777 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 616/1234] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:04:31 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:04:50.738407 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:04:50.739884 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:04:50.826377 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec5139-c1b5-4843-88b3-1360ff5c6530 None None] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:04:50.831870 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:04:50.832510 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:04:50.832791 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:04:50.833067 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:04:50.834834 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:04:50.847495 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:04:50.849074 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:04:50.858504 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 619/1235] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:04:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:06:41.531765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:06:41.532226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:06:41.532435 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:06:41.551090 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:06:41.552340 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:06:41.559169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 617/1236] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:06:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 17:06:42.292752 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:06:42.301498 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35a99-a786-49d5-a844-195b78cd5f2c service placement] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:06:42.305044 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:06:42.305673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:06:42.305950 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:06:42.306434 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:06:42.308333 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:06:42.319184 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:06:42.320666 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:06:42.330087 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 620/1237] 10.222.0.58 () {60 vars in 1396 bytes} [Wed May 11 17:06:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2804 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:06:52.839408 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:06:52.848807 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b063e8-f36f-496e-81ae-861fa3da268f None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:06:52.852262 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:06:52.852897 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:06:52.853174 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:06:52.853447 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:06:52.855193 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:06:52.921497 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:06:52.922959 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365290-3aac-400f-a973-1453362db9a6 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:06:52.943176 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 618/1238] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:06:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:07:54.407253 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:07:54.408962 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:07:54.420409 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60b06-036c-41b0-a945-65cbfcc2f6bf service neutron] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:07:54.423913 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:07:54.424542 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:07:54.424819 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:07:54.425090 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:07:54.427272 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:07:54.437324 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:07:54.438729 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:07:54.447657 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 621/1239] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:07:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:08:47.077443 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] REQUEST_METHOD: `POST` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:47.077914 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:47.078013 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:47.094877 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.auth.core [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] MFA Rules not processed for user `ce514e3a7aab4a0fb0d25dee5161d4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86709) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 17:08:47.096072 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:47.103178 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 619/1240] 10.222.0.58 () {58 vars in 957 bytes} [Wed May 11 17:08:47 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 17:08:47.137481 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:08:47.138932 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:47.210570 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d57d5-2de6-4c43-8eed-eb2f15d94def service neutron] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:08:47.214839 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24d4c4c8b0c740eeb45cae6aca0cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:08:47.215521 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:47.215798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:47.216068 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:47.218210 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:47.230790 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:08:47.232231 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:08:47.241893 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 622/1241] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:08:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:08:47.522297 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:08:47.532563 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d358a5b-6679-473b-ab2e-96689e60a8c4 None None] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:08:47.536179 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:08:47.536812 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:47.537093 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:47.537369 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:47.539099 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:47.548910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:08:47.550323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:08:47.557952 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 620/1242] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:08:47 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:08:47.981993 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:08:47.983506 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:47.997582 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f4e8-7da9-436b-a7cb-7827b55e83c2 service cinder] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:08:48.002546 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:08:48.003189 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:48.003503 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:48.003776 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:48.005521 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:48.017595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:08:48.019169 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:08:48.028914 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 623/1243] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:08:47 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:08:50.348383 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:08:50.350106 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:50.374912 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbc29-9fa5-4c7d-af4a-248ad82692b7 service neutron] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:08:50.380944 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:08:50.381609 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:50.381890 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:50.382323 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:50.386902 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:50.399555 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:08:50.401942 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:08:50.412914 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 621/1244] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:08:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:08:55.713207 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:08:55.716178 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:55.731433 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468eb56-cd0e-4ad9-a59d-c8b7afd0a001 service placement] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:08:55.736509 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:08:55.737153 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:08:55.737438 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:08:55.737718 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:08:55.739532 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:08:55.750753 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:08:55.752447 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:08:55.763798 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 624/1245] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:08:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:09:00.353768 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:09:00.367331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434ddac-c6cd-4906-9bd3-c4e3ce4796d8 service nova] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:09:00.375640 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d73b4a0e1646a19c1c70479a98a736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:09:00.376572 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:09:00.376992 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:09:00.377373 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:09:00.379502 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:09:00.392371 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:09:00.393943 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:09:00.404961 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 622/1246] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:09:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:09:57.682131 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:09:57.724258 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa6a6-757f-4994-85a9-6efc3f13bb60 service nova] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:09:57.729166 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:09:57.729737 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:09:57.730014 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:09:57.730285 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:09:57.738369 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:09:57.739975 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:09:57.749315 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 625/1247] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:09:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:11:19.414776 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:11:19.433169 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40722d1-d47c-4ac0-9642-cf0b7e70a8b2 service nova] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:11:19.437559 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1f023aee544e4fa1c31808f7b3ba4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:11:19.438447 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:11:19.438765 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:11:19.439062 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:11:19.443309 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:11:19.535226 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:11:19.536688 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:11:19.546465 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 623/1248] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:11:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 17:11:25.978262 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:11:25.979766 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:11:25.993959 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa171b-3122-4c69-a834-d0e1e896dda9 service placement] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:11:25.998454 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:11:25.999326 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:11:25.999660 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:11:25.999930 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] PATH_INFO: `/v3/users/ce514e3a7aab4a0fb0d25dee5161d4d1` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:11:26.001122 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce514e3a7aab4a0fb0d25dee5161d4d1)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:11:26.003034 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:11:26.052933 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce514e3a7aab4a0fb0d25dee5161d4d1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.053575 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce514e3a7aab4a0fb0d25dee5161d4d1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.064711 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce514e3a7aab4a0fb0d25dee5161d4d1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.072145 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce514e3a7aab4a0fb0d25dee5161d4d1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.072751 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce514e3a7aab4a0fb0d25dee5161d4d1'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.084500 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 626/1249] 10.222.0.58 () {58 vars in 1223 bytes} [Wed May 11 17:11:25 2022] DELETE /identity/v3/users/ce514e3a7aab4a0fb0d25dee5161d4d1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:11:26.265195 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:11:26.275566 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bfdd2-61fa-4e5a-9556-06abd82fd3a0 service neutron] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:11:26.329691 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:11:26.330547 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:11:26.330832 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:11:26.331105 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] PATH_INFO: `/v3/projects/0719ca3797ea4697b9d6512af2642e6d` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:11:26.332815 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0719ca3797ea4697b9d6512af2642e6d)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:11:26.334735 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:11:26.378837 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0719ca3797ea4697b9d6512af2642e6d', 'request_id': 'req-0c9162af-4108-4c61-ad32-cbd73d03b7c6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.386872 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0719ca3797ea4697b9d6512af2642e6d', 'request_id': 'req-0c9162af-4108-4c61-ad32-cbd73d03b7c6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.392310 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0719ca3797ea4697b9d6512af2642e6d', 'request_id': 'req-0c9162af-4108-4c61-ad32-cbd73d03b7c6'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.403366 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] The token cache is being invalidate because project 0719ca3797ea4697b9d6512af2642e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 17:11:26.403661 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.404277 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.405792 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 624/1250] 10.222.0.58 () {58 vars in 1232 bytes} [Wed May 11 17:11:26 2022] DELETE /identity/v3/projects/0719ca3797ea4697b9d6512af2642e6d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:11:26.410284 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:11:26.411719 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:11:26.424837 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9d83-f8df-4e7c-8945-2d4ffaf9308d admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:11:26.479219 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:11:26.480057 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:11:26.480338 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:11:26.480611 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] PATH_INFO: `/v3/users/b079ab6b0a344280969fcf70d6f30bdd` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:11:26.481783 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b079ab6b0a344280969fcf70d6f30bdd)` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:11:26.483799 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:11:26.528595 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b079ab6b0a344280969fcf70d6f30bdd'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.529354 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b079ab6b0a344280969fcf70d6f30bdd'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.540939 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b079ab6b0a344280969fcf70d6f30bdd'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.547691 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b079ab6b0a344280969fcf70d6f30bdd'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.548292 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.notifications [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b079ab6b0a344280969fcf70d6f30bdd'} {{(pid=86710) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.559673 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 627/1251] 10.222.0.58 () {58 vars in 1223 bytes} [Wed May 11 17:11:26 2022] DELETE /identity/v3/users/b079ab6b0a344280969fcf70d6f30bdd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:11:26.724564 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Authenticating user token {{(pid=86709) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:11:26.726068 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.fernet_utils [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86709) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:11:26.739108 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9162af-4108-4c61-ad32-cbd73d03b7c6 admin admin] Validating token access rules against request {{(pid=86709) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:11:26.792474 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20792e246db94bf6a86a88130fe78b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f17a7c59ed4e463892351b1b51c21b1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86709) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:11:26.793331 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:11:26.793611 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:11:26.793883 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] PATH_INFO: `/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129` {{(pid=86709) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:11:26.795046 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e66089a9d8b4d8d93df8f8bf7517129)` {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:11:26.797012 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] RBAC: Authorization granted {{(pid=86709) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:11:26.841910 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e66089a9d8b4d8d93df8f8bf7517129', 'request_id': 'req-cbaac96b-acd7-40d7-9f95-ad69ff574281'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.849297 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e66089a9d8b4d8d93df8f8bf7517129', 'request_id': 'req-cbaac96b-acd7-40d7-9f95-ad69ff574281'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.854641 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e66089a9d8b4d8d93df8f8bf7517129', 'request_id': 'req-cbaac96b-acd7-40d7-9f95-ad69ff574281'} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.865455 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] The token cache is being invalidate because project 1e66089a9d8b4d8d93df8f8bf7517129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86709) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 17:11:26.865739 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.866384 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: DEBUG keystone.notifications [None req-cbaac96b-acd7-40d7-9f95-ad69ff574281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86709) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 17:11:26.867935 dv-osbrick-836062-3-ceph devstack@keystone.service[86709]: [pid: 86709|app: 0|req: 625/1252] 10.222.0.58 () {58 vars in 1232 bytes} [Wed May 11 17:11:26 2022] DELETE /identity/v3/projects/1e66089a9d8b4d8d93df8f8bf7517129 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 17:15:01.658401 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Authenticating user token {{(pid=86710) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 17:15:01.659856 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:15:01.754278 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5caa3f-07a1-4fed-acb7-06c77b7c0a72 admin admin] Validating token access rules against request {{(pid=86710) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 17:15:01.809770 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02582a7f42294aa883540235c867979a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cce53653c2c47039a2111ec785ab54d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86710) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 17:15:01.810442 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] REQUEST_METHOD: `GET` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 17:15:01.810724 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] SCRIPT_NAME: `/identity` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 17:15:01.810998 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86710) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 17:15:01.812771 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.fernet_utils [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86710) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 17:15:01.823781 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 17:15:01.825361 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcf9b7-b91a-431b-ac99-4055c03230e6 service placement] RBAC: Authorization granted {{(pid=86710) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 17:15:01.834688 dv-osbrick-836062-3-ceph devstack@keystone.service[86710]: [pid: 86710|app: 0|req: 628/1253] 10.222.0.58 () {60 vars in 1365 bytes} [Wed May 11 17:15:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)